-- Logs begin at Wed 2021-12-15 12:24:52 UTC, end at Wed 2021-12-15 13:23:20 UTC. -- Dec 15 12:55:31.180085 dv-cinder-813226-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 15 12:55:31.187521 dv-cinder-813226-4-iscsi devstack@n-api.service[101910]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 15 12:55:31.189537 dv-cinder-813226-4-iscsi devstack@n-api.service[101910]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 15 12:55:31 2021] *** Dec 15 12:55:31.189537 dv-cinder-813226-4-iscsi devstack@n-api.service[101910]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 15 12:55:31.189537 dv-cinder-813226-4-iscsi devstack@n-api.service[101910]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 15 12:55:31.189537 dv-cinder-813226-4-iscsi devstack@n-api.service[101910]: nodename: dv-cinder-813226-4-iscsi Dec 15 12:55:31.189537 dv-cinder-813226-4-iscsi devstack@n-api.service[101910]: machine: x86_64 Dec 15 12:55:31.189537 dv-cinder-813226-4-iscsi devstack@n-api.service[101910]: clock source: unix Dec 15 12:55:31.189537 dv-cinder-813226-4-iscsi devstack@n-api.service[101910]: pcre jit disabled Dec 15 12:55:31.189537 dv-cinder-813226-4-iscsi devstack@n-api.service[101910]: detected number of CPU cores: 4 Dec 15 12:55:31.189537 dv-cinder-813226-4-iscsi devstack@n-api.service[101910]: current working directory: / Dec 15 12:55:31.189537 dv-cinder-813226-4-iscsi devstack@n-api.service[101910]: detected binary path: /usr/bin/uwsgi-core Dec 15 12:55:31.190784 dv-cinder-813226-4-iscsi devstack@n-api.service[101910]: your processes number limit is 47680 Dec 15 12:55:31.190784 dv-cinder-813226-4-iscsi devstack@n-api.service[101910]: your memory page size is 4096 bytes Dec 15 12:55:31.190784 dv-cinder-813226-4-iscsi devstack@n-api.service[101910]: detected max file descriptor number: 2048 Dec 15 12:55:31.190784 dv-cinder-813226-4-iscsi devstack@n-api.service[101910]: lock engine: pthread robust mutexes Dec 15 12:55:31.190784 dv-cinder-813226-4-iscsi devstack@n-api.service[101910]: thunder lock: enabled Dec 15 12:55:31.191520 dv-cinder-813226-4-iscsi devstack@n-api.service[101910]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 15 12:55:31.191620 dv-cinder-813226-4-iscsi devstack@n-api.service[101910]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 15 12:55:31.235908 dv-cinder-813226-4-iscsi devstack@n-api.service[101910]: Python main interpreter initialized at 0x559cef97a9c0 Dec 15 12:55:31.235908 dv-cinder-813226-4-iscsi devstack@n-api.service[101910]: python threads support enabled Dec 15 12:55:31.235908 dv-cinder-813226-4-iscsi devstack@n-api.service[101910]: your server socket listen backlog is limited to 100 connections Dec 15 12:55:31.235908 dv-cinder-813226-4-iscsi devstack@n-api.service[101910]: your mercy for graceful operations on workers is 90 seconds Dec 15 12:55:31.236242 dv-cinder-813226-4-iscsi devstack@n-api.service[101910]: mapped 403077 bytes (393 KB) for 2 cores Dec 15 12:55:31.236359 dv-cinder-813226-4-iscsi devstack@n-api.service[101910]: *** Operational MODE: preforking *** Dec 15 12:55:31.236620 dv-cinder-813226-4-iscsi devstack@n-api.service[101910]: *** uWSGI is running in multiple interpreter mode *** Dec 15 12:55:31.236620 dv-cinder-813226-4-iscsi devstack@n-api.service[101910]: spawned uWSGI master process (pid: 101910) Dec 15 12:55:31.236845 dv-cinder-813226-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 15 12:55:31.238916 dv-cinder-813226-4-iscsi devstack@n-api.service[101910]: spawned uWSGI worker 1 (pid: 101911, cores: 1) Dec 15 12:55:31.238916 dv-cinder-813226-4-iscsi devstack@n-api.service[101910]: spawned uWSGI worker 2 (pid: 101912, cores: 1) Dec 15 12:55:31.238916 dv-cinder-813226-4-iscsi devstack@n-api.service[101910]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 15 12:55:32.948862 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 12:55:32.948862 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: from cryptography.utils import int_from_bytes Dec 15 12:55:32.949503 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 12:55:32.949503 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: from cryptography.utils import int_from_bytes Dec 15 12:55:32.953656 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 12:55:32.953656 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: from cryptography.utils import int_from_bytes Dec 15 12:55:32.954158 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 12:55:32.954158 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: from cryptography.utils import int_from_bytes Dec 15 12:55:35.516744 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 12:55:35.517282 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 12:55:35.517477 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 12:55:35.518376 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 12:55:35.518631 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 12:55:35.519017 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.519341 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.519658 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.519747 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 12:55:35.520121 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 12:55:35.520198 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.520304 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.520389 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 12:55:35.520590 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.520744 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 12:55:35.520902 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.520996 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 12:55:35.521218 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.521372 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.521543 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.521697 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.521799 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.522019 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.522103 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.522375 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.522462 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813226-4-iscsi {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.522707 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.522801 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.523019 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.523102 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.523335 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.523425 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.523653 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.523749 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.523957 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.524040 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.524222 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.524304 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.524537 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.524630 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.524863 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813226-4-iscsi {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.525046 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.526388 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.526520 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.526682 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.526838 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.526952 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.527102 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.527222 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.527368 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.527517 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.527643 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.527790 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.527905 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.528020 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.528175 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.528565 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.528691 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.528842 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.528957 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.529101 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.529222 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.529372 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.529487 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813226-4-iscsi {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.529629 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.529754 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.529904 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.530024 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.530177 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.530333 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.530463 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.530607 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.530729 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.530878 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.530992 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.531104 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.531340 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.531425 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.531507 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813226-4-iscsi {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.531624 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.531713 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.531835 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.531950 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.532033 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.532121 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.532267 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.532498 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.532612 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.532807 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.532907 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.533115 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.533211 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.533992 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.534097 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.534370 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.534475 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.534681 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.534767 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.535007 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.535099 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.535310 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.535517 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.535610 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.535851 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.535941 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.536168 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.536261 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.536485 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.536572 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.536804 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.536889 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.537052 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.537149 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.537299 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.537420 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.537613 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.537725 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.537929 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.538023 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.538261 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.538358 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.538564 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.538658 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.538867 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.538961 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.539169 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.539263 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.539472 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.539564 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.539769 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.539857 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.540022 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.540114 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.540341 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.540427 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.540662 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.540749 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.540972 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.541065 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.541303 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.541397 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.541606 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.541691 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.541910 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.542001 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.542237 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.542352 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.542574 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.542681 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.542878 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.542975 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.543184 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.543287 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.543502 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.543595 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.543809 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.543893 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.544126 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.544220 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.544430 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.544515 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.544733 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.544822 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.545035 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.545122 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.545338 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.545429 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.545653 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.545739 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.545982 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.546073 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.546308 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.546395 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.546582 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.546666 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.546881 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.546967 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.547184 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.547269 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.547497 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.547581 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.547799 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.547884 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.548100 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.548184 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.548399 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.548492 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.548693 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.548787 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.549017 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.549101 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.549309 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.549408 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.549609 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.549694 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.549912 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.549995 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.550244 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.550349 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.550546 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.550632 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.550848 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.550932 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.551149 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.551242 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.551447 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.551537 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.551753 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.551837 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.552058 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.552151 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.552359 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.552449 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.552663 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.552759 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.552958 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.553043 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.553259 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.553349 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.553564 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.553656 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.553861 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.553954 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.554177 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.554264 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.554501 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.554602 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.554802 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.554887 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.555103 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.555187 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.555410 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.555500 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.555711 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.555809 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.556013 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.556103 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.556328 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.556421 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.556627 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.556714 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.556926 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.557009 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.557238 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.557320 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.557540 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.557631 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.557840 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.557923 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.558139 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.558256 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.558461 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.558555 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.558764 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.558849 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.559064 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.559154 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.559364 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.559450 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.559665 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.559748 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.559960 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.560055 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.560270 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.560354 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.560575 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.560659 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.560879 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.560971 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.561179 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.561263 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.561479 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.561561 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.561781 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.561873 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.562084 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.562197 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.562416 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.562502 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.562714 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.562825 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.563030 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.563115 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.563350 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.563442 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.563658 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.563745 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.563965 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.564051 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.564270 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.564355 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.564611 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:55:35.564697 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.564935 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.565018 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.565244 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.565329 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.565554 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.565639 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.565861 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.565945 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.566195 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.566297 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.566511 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.566603 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.566837 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.566922 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.567152 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.567252 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.567467 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.567558 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.567782 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.567867 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.568091 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.568193 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.568401 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.568496 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.568724 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.568819 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.569040 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.569138 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.569347 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.569434 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.569685 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.569770 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.570014 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.570113 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.570355 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.570440 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.570672 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.570759 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.570979 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.571073 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.571294 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.571379 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.571602 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.571691 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.571912 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.571998 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.572220 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.572304 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.572545 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.572637 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.572883 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.572995 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.573157 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.573243 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.573490 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.573577 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.573802 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.573888 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.574113 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.574227 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.574441 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.574527 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.574747 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.574834 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.575051 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.575138 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.575360 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.575454 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.575662 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.575748 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.575981 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.576073 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.576307 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.576400 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.576612 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.576709 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.576928 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.577021 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.577233 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.577331 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.577539 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.577626 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.577843 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.577928 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.578166 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.578335 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.578470 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.578556 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.578776 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.578861 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.579079 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.579166 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.579398 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.579488 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.579706 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.579791 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.580011 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.580103 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.580856 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.580941 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.581158 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.581243 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.581460 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.581554 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.581768 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.581860 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.582075 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.582184 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.582407 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.582493 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.582716 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.582807 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.583031 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.583155 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.583334 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.583442 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.583636 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.583729 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.583947 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.584041 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.584253 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.584338 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.584565 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.584656 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.584874 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.584976 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.585182 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.585268 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.585494 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.585590 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.585791 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.585888 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.586097 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.586252 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.586423 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.586508 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.586723 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.586817 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.587024 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.587110 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.587331 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.587416 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.587632 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.587719 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.587932 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.588017 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.588231 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.588317 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.588530 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.588623 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.588826 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.588918 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.589148 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.589248 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.589453 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.589539 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.589755 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.589845 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.590055 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.590167 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.590380 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.590466 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.590684 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.590768 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.590990 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.591089 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.591293 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.591379 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.591595 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.591680 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.591916 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.592009 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.592225 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.592311 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.592529 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.592614 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.592831 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.592926 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.593138 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.593243 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.593447 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.593543 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.593752 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.593851 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.594059 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.594163 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.594404 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.594490 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.594713 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.594800 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.595028 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.595114 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.595335 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.595421 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.595659 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.595756 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.596554 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.596658 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.596846 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.596940 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.597149 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.597235 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.597461 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.597547 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.597780 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.597873 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.598095 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.598233 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.598442 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.598528 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.598755 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.598854 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.599062 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.599154 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.599374 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.599459 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.599683 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.599776 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.599988 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.600079 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.600298 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.600394 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.600603 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.600698 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.600916 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.601002 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.601224 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.601316 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.601539 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.601637 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.601844 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.601936 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.602185 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.602275 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.602494 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.602587 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.602806 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.602891 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.603105 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.603202 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.603420 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.603516 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.603737 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.603824 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.604049 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.604145 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.604362 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.604448 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.604670 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.604754 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.604987 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.605071 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.605297 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.605382 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.605602 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.605701 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.605913 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.605998 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.606239 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.606328 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.606570 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.606655 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.606881 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.606998 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.607196 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.607289 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.607506 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.607598 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.607815 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.607977 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.608119 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.608205 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.608429 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.608519 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.608735 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.608827 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.609038 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.609125 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.609341 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.609426 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.609650 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.609743 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.609968 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.610052 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.610305 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.610394 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.610619 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.610705 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.610929 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.611014 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.611231 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.611314 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.611555 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.611643 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.611878 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.611962 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.612184 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.612268 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.612483 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.612568 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.612783 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.612868 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.613085 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.613170 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.613432 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.613537 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.613736 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.613827 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.614039 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.614175 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.614369 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.614466 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.614686 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.614777 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.614996 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.615089 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.615305 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.615399 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.615611 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.615727 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.615918 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.616015 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.616238 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.616323 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.616550 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.616634 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.616857 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.616951 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.617165 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.617256 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.617474 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.617624 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.617781 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.617870 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.618089 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.618215 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.618425 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.618510 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.618733 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.618827 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.619044 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.619135 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.619351 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.619436 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.619655 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.619741 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.619962 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.620043 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.620272 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.620357 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.620583 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.620835 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.620920 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.621160 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.621244 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.621470 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.621555 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.621786 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.621878 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.622092 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.622194 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.622421 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.622508 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.622733 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.622826 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.623053 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.623139 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.623360 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.623618 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.623715 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.623947 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.624039 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.624250 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.624344 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.624552 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.624637 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.624860 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.624944 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.625161 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.625248 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.625462 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.625548 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.625762 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.625853 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.626069 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.626192 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.626397 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.626482 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.626698 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.626795 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.627525 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.627621 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.627846 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.627940 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.628155 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.628241 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.628455 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.628553 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.628758 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.628850 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.629056 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.629141 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.629362 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.629455 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.629667 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.629752 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.629964 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.630049 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.630287 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.630390 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.630595 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.630680 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.630910 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.631003 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.631213 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.631305 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.631523 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.631610 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.631826 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.631912 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.632150 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.632313 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.632460 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.632547 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.632764 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.632847 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.633063 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.633156 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.633366 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.633448 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.633668 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.633779 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.633970 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.634077 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.634299 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.634397 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.634606 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.634691 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.634906 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.635000 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.635213 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.635298 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.635516 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.635601 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.635822 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.635909 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.636129 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.636214 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.636426 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.636510 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.636730 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.636823 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.637030 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.637116 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.637340 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.637427 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.637640 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.637725 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.637935 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.638019 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.638258 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.638349 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.638567 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.638654 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.638872 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.638963 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.639169 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.639261 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.639475 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.639559 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.639769 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.639852 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.640079 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.640172 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.640379 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.640464 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.640679 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.640764 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.640975 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.641073 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.641280 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.641373 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.641585 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.641670 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.641882 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.641975 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.642208 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.642306 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.642514 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.642605 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.643364 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.643464 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.643664 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.643765 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.643968 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.644070 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.644263 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.644349 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.644563 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.644647 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.644866 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.644951 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.645166 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.645259 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.645483 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.645569 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.645783 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.645870 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.646084 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.646189 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.646415 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.646502 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.646716 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.646809 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.647018 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.647102 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.647320 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.647413 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.647616 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.647709 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.647916 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.648002 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.648216 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.648301 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.648514 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.648608 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.648812 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.648910 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.649112 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.649196 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.649415 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.649512 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.649712 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.649796 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.650011 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.650096 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.650337 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.650450 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.650639 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.650725 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.650943 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.651029 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.651247 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.651340 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.651549 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.651635 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.651870 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.651962 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.652178 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.652272 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.652480 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.652569 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.652784 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.652868 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.653083 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.653169 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.653643 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.653727 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.653965 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.654058 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.654292 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.654393 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.654603 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.654712 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.654903 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.654997 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.655202 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.655295 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.655520 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.655605 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.655827 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.655921 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.656131 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.656214 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.656446 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.656538 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.656759 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.656853 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.657068 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.657154 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.657366 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.657455 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.657669 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.657762 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.657973 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.658065 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.658322 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.658429 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.658629 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.658741 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.658935 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.659021 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.659242 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.659328 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.659549 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.659636 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.659855 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.659941 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.660159 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.660251 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.660464 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.660549 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.660769 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.660856 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.661073 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.661157 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.661377 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.661471 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.661676 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.661762 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.661984 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.662076 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.662315 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.662403 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.662616 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.662715 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.662921 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.663015 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.663224 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.663309 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.663537 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.663827 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.663904 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.664151 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.664238 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.664463 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.664548 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.664769 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.664854 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.665097 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.665183 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.665405 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.665491 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.665711 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.665805 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.666021 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.666105 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.666357 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.666452 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.666686 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.666787 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.666963 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.667055 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.667363 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.667447 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.667672 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.667766 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.667980 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.668062 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.668281 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.668367 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.668581 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.668674 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.668886 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.668979 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.669205 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.669297 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.669505 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.669659 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.669805 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.669972 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.670104 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.670417 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.670521 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.670728 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.670815 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.671051 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.671378 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.671463 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.671759 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.671986 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.672073 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.672456 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.672540 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.672764 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.673019 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.673116 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.673375 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.673691 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.673776 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.674038 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.674371 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.674462 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.674682 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.674921 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.675144 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.675297 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.675488 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.675616 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.675922 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.676078 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.676233 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.676536 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.676723 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.676853 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.677174 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.677285 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.677483 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.677767 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.677854 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.678221 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.678309 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.678546 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.678645 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.678854 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.679060 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.679173 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.679498 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.679588 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.679801 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.679887 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.680101 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.680192 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.680409 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.680700 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.680794 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.681008 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.681091 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.681327 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.681412 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.681629 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.681715 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.681935 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.682042 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.682266 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.682388 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.682572 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.682723 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.682872 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.683055 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.683173 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.683375 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.683489 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.683697 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.683792 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.684009 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.684094 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.684337 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.684424 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.684664 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.684758 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.684982 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.685076 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.685288 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.685373 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.685608 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.685702 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.685914 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.686030 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.686238 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.686370 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.686543 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.686703 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.686841 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.687037 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.687181 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.687344 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.687484 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.687654 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.687802 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.687967 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.688131 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.688274 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.688455 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.688581 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.688761 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.688906 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.689091 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.689227 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.689415 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.690013 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.690266 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.690364 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.690592 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.690685 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.690916 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.691003 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.691219 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.691311 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.691525 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.691622 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.691833 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.691918 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.692136 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.692219 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.692440 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.692538 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.692744 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.692829 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.693051 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.693136 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.693351 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.693445 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.693652 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.693737 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.693954 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.694046 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.694298 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.694401 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.694600 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.694683 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.694903 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.694986 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.695214 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.695305 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.695515 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.695600 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.695816 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.695901 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.696119 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.696214 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.696459 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.696544 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.696764 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.696868 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.697092 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.697186 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.697410 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.697496 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.697726 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.697819 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.698044 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.698130 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.698376 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.698460 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.698688 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.698789 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.698994 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.699079 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.699306 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.699390 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.699598 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.699700 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.699906 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.699992 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.700211 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.700297 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.700522 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.700617 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.700826 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.700907 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.701128 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.701220 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.701432 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.701526 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.701742 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.701832 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.702044 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.702127 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.702392 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.702591 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.702704 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.702923 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.703008 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.703239 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.703371 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.703555 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.703640 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.703869 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.703959 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.704181 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.704275 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.704495 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.704581 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.704807 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.704892 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.705118 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.705776 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.705983 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.706069 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.706318 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.706407 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.706647 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.706734 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.706966 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.707062 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.707284 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.707371 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.707601 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.707688 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.707916 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.708002 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.708231 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.708315 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.708544 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.708629 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.708855 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.708940 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.709164 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.709261 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.709477 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.709563 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.709792 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.709877 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.710102 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.710219 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.710441 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.710650 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.710759 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.710980 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.711106 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.711295 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.711381 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.711608 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.711699 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.711922 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.712016 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.712237 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.712321 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.712549 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.712633 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.712859 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.712950 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.713168 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.713252 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.713477 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.713561 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.713785 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.713879 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.714111 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.714214 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.714455 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.714539 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.714769 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.714856 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.715084 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.715169 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.715406 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.715599 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.715723 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.715916 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.716039 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.716250 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.716356 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.716576 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.716713 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.716902 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.717031 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.717216 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.717340 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.717531 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.717654 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.717856 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.717971 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.718178 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.718311 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.718487 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.718626 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.718798 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.718937 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.719107 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.719253 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.719410 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.719569 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.719728 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.719881 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.720038 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.720192 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.720341 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.720506 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.720664 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.720843 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.720995 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.721171 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.721508 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.721592 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.721828 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.721913 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.722157 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.722256 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.722481 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.722566 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.722799 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.722884 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.723111 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.723316 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.723402 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.723632 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.723716 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.723968 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.724064 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.724293 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.724378 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.724607 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.724689 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.724916 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.725009 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.725218 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.725309 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.725520 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.725606 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.725829 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.725922 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.726131 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.726230 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.726457 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.726540 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.726765 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.726852 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.727065 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.727153 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.727387 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.727471 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.727689 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.727782 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.727991 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.728076 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.728292 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.728378 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.728601 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.728683 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.728903 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.729133 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.729218 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.729483 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.729570 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.729781 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.729864 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.730090 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.730206 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.730417 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.730512 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.730730 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.730816 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.731032 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.731116 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.731339 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.731424 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.731641 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.731726 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.731947 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.732038 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.732302 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.732399 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.732555 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.732642 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.732857 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.732952 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.733159 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.733254 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.733469 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.733562 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.733774 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.733867 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.734078 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.734188 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.734417 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.734506 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.734721 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.734818 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.735045 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.735129 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.735352 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.735438 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.735656 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.735880 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.735967 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.736260 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.736345 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.736608 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.736756 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.736943 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.737042 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.737281 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.737374 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.737584 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.737677 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.737886 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.737971 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.738210 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.738301 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.738523 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.738621 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.738830 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.738917 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.739136 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.739228 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.739438 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.739601 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.739743 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.739829 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.740045 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.740139 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.740352 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.740441 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.740663 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.740749 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.740967 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.741065 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.741272 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.741358 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.741583 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.741667 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.741907 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.741998 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.742244 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.742332 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.742557 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.742642 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.742871 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.742958 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.743185 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.743273 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.743492 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.743723 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.743809 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.744095 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.744181 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.744401 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.744493 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.744711 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.744797 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.745037 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.745124 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.745348 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.745435 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.745650 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.745736 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.745955 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.746066 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.746301 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.746390 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.746616 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.746780 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.746929 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.747022 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.747240 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.747331 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.747550 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.747645 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.747861 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.747959 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.748172 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.748258 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.748482 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.748576 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.748791 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.748874 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.749101 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.749186 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.749416 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.749515 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.749745 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.749860 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.750065 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.750174 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.750394 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.750481 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.750701 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.750795 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.751004 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.751091 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.751311 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.751399 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.751622 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.751709 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.751931 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.752531 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.752773 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.752860 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.753088 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.753180 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.753394 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.753487 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.753717 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.753803 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.754020 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.754109 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.754364 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.754459 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.754685 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.754771 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.754999 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.755085 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.755307 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.755401 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.755635 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.755728 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.755944 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.756031 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.756252 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.756339 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.756560 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.756646 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.756867 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.756954 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.757173 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.757266 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.757480 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.757567 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.757801 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.757887 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.758123 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.758227 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.758446 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.758532 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.758767 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.758862 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.759072 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.759165 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.759376 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.759462 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.759684 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.759783 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.759988 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.760086 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.760313 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.760399 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.760619 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.760712 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.760930 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.761022 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.761242 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.761333 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.761550 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.761638 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.761857 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.761950 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.762184 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.762273 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.762512 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.762600 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.762827 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.762913 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.763140 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.763232 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.763461 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.763547 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.763768 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.763853 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.764079 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.764166 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.764392 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.764485 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.764702 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.764789 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.765011 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.765111 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.765322 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.765410 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.765621 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.765706 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.765860 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 12:55:35.765953 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.766276 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.766607 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.766968 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.767245 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.767560 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.768432 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.768759 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.769071 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.769387 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.769695 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.770006 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.770433 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.770760 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.771088 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.771417 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.771745 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.772073 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.772418 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.772730 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.773070 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.773397 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.773713 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.774025 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.774364 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:55:35.774608 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 12:55:35.789604 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG oslo_db.sqlalchemy.engines [None req-69730c2f-101e-4f27-bf78-3ec829089e6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101911) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 12:55:35.797125 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG oslo_db.sqlalchemy.engines [None req-1fef131c-e3ee-46d5-a4e3-ed0b9082f286 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101912) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 12:55:35.853726 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.context [None req-69730c2f-101e-4f27-bf78-3ec829089e6b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8e3cf188-1511-4f3a-b1c2-340794a1deea(cell1) {{(pid=101911) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 12:55:35.857922 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG oslo_concurrency.lockutils [None req-69730c2f-101e-4f27-bf78-3ec829089e6b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:35.859538 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG oslo_concurrency.lockutils [None req-69730c2f-101e-4f27-bf78-3ec829089e6b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:35.860325 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG oslo_concurrency.lockutils [None req-69730c2f-101e-4f27-bf78-3ec829089e6b None None] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:35.861463 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.context [None req-1fef131c-e3ee-46d5-a4e3-ed0b9082f286 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8e3cf188-1511-4f3a-b1c2-340794a1deea(cell1) {{(pid=101912) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 12:55:35.862374 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG oslo_concurrency.lockutils [None req-69730c2f-101e-4f27-bf78-3ec829089e6b None None] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:35.865692 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG oslo_concurrency.lockutils [None req-1fef131c-e3ee-46d5-a4e3-ed0b9082f286 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:35.867297 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG oslo_concurrency.lockutils [None req-1fef131c-e3ee-46d5-a4e3-ed0b9082f286 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:35.868108 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG oslo_concurrency.lockutils [None req-1fef131c-e3ee-46d5-a4e3-ed0b9082f286 None None] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:35.870093 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG oslo_concurrency.lockutils [None req-1fef131c-e3ee-46d5-a4e3-ed0b9082f286 None None] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:35.872720 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG oslo_db.sqlalchemy.engines [None req-69730c2f-101e-4f27-bf78-3ec829089e6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101911) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 12:55:35.875321 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG oslo_db.sqlalchemy.engines [None req-69730c2f-101e-4f27-bf78-3ec829089e6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101911) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 12:55:35.883296 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG oslo_db.sqlalchemy.engines [None req-1fef131c-e3ee-46d5-a4e3-ed0b9082f286 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101912) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 12:55:35.886046 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG oslo_db.sqlalchemy.engines [None req-1fef131c-e3ee-46d5-a4e3-ed0b9082f286 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101912) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 12:55:36.045692 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG oslo_db.sqlalchemy.engines [None req-69730c2f-101e-4f27-bf78-3ec829089e6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101911) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 12:55:36.048342 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG oslo_db.sqlalchemy.engines [None req-1fef131c-e3ee-46d5-a4e3-ed0b9082f286 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101912) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 12:55:36.389589 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: WARNING keystonemiddleware.auth_token [None req-1fef131c-e3ee-46d5-a4e3-ed0b9082f286 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 12:55:36.396865 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: WARNING keystonemiddleware.auth_token [None req-1fef131c-e3ee-46d5-a4e3-ed0b9082f286 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 12:55:36.397143 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: WARNING keystonemiddleware.auth_token [None req-69730c2f-101e-4f27-bf78-3ec829089e6b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 12:55:36.404009 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: WARNING keystonemiddleware.auth_token [None req-69730c2f-101e-4f27-bf78-3ec829089e6b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 12:55:36.734165 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: WARNING keystonemiddleware.auth_token [None req-1fef131c-e3ee-46d5-a4e3-ed0b9082f286 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 12:55:36.739924 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: WARNING keystonemiddleware.auth_token [None req-1fef131c-e3ee-46d5-a4e3-ed0b9082f286 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 12:55:36.745025 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559cef97a9c0 pid: 101912 (default app) Dec 15 12:55:36.745452 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: WARNING keystonemiddleware.auth_token [None req-69730c2f-101e-4f27-bf78-3ec829089e6b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 12:55:36.747114 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-1fef131c-e3ee-46d5-a4e3-ed0b9082f286 None None] Calling method '>' {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:36.748269 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-1fef131c-e3ee-46d5-a4e3-ed0b9082f286 None None] 10.222.0.57 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001734 Dec 15 12:55:36.748676 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 788 bytes} [Wed Dec 15 12:55:36 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:55:36.750768 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: WARNING keystonemiddleware.auth_token [None req-69730c2f-101e-4f27-bf78-3ec829089e6b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 12:55:36.756450 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559cef97a9c0 pid: 101911 (default app) Dec 15 12:56:58.664578 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-1fef131c-e3ee-46d5-a4e3-ed0b9082f286 None None] Calling method '>' {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:58.665582 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-1fef131c-e3ee-46d5-a4e3-ed0b9082f286 None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Dec 15 12:56:58.668822 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 2/2] 10.222.0.57 () {54 vars in 930 bytes} [Wed Dec 15 12:56:58 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:56:59.108578 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-21f49b27-f65b-4d25-91f8-bd48f96f7e35 admin admin] Calling method '>' {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:59.137046 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-21f49b27-f65b-4d25-91f8-bd48f96f7e35 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.463683 Dec 15 12:56:59.137938 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 1/3] 10.222.0.57 () {60 vars in 1291 bytes} [Wed Dec 15 12:56:58 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:57:01.551264 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-1fef131c-e3ee-46d5-a4e3-ed0b9082f286 None None] Calling method '>' {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:01.552900 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-1fef131c-e3ee-46d5-a4e3-ed0b9082f286 None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002057 Dec 15 12:57:01.554372 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 3/4] 10.222.0.57 () {54 vars in 930 bytes} [Wed Dec 15 12:57:01 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:57:01.622899 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-f0347c79-6bc0-44fe-a0de-f306a3c55bd8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "vcpus": 1, "id": "c1", "name": "cirros256", "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:57:01.643110 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:57:01.643110 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: warnings.warn(msg) Dec 15 12:57:01.673311 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-f0347c79-6bc0-44fe-a0de-f306a3c55bd8 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.112178 Dec 15 12:57:01.678489 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 2/5] 10.222.0.57 () {64 vars in 1282 bytes} [Wed Dec 15 12:57:01 2021] POST /compute/v2.1/flavors => generated 407 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:57:01.892951 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-7b9469e6-e1bf-48a4-99a1-dcf298775de0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:57:01.895396 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:57:01.895396 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: warnings.warn(msg) Dec 15 12:57:01.944752 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-7b9469e6-e1bf-48a4-99a1-dcf298775de0 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.262182 Dec 15 12:57:01.945543 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 4/6] 10.222.0.57 () {64 vars in 1335 bytes} [Wed Dec 15 12:57:01 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:04.396911 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-f0347c79-6bc0-44fe-a0de-f306a3c55bd8 admin admin] Calling method '>' {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:04.398592 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-f0347c79-6bc0-44fe-a0de-f306a3c55bd8 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002084 Dec 15 12:57:04.398983 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 3/7] 10.222.0.57 () {54 vars in 930 bytes} [Wed Dec 15 12:57:04 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:57:04.519130 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-e64311b6-9d72-443d-bf60-36fea7ec7fb8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "disk": 5, "vcpus": 1, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "id": "d1"}} {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:57:04.539030 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:57:04.539030 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: warnings.warn(msg) Dec 15 12:57:04.559962 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-e64311b6-9d72-443d-bf60-36fea7ec7fb8 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.153616 Dec 15 12:57:04.561775 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 5/8] 10.222.0.57 () {64 vars in 1282 bytes} [Wed Dec 15 12:57:04 2021] POST /compute/v2.1/flavors => generated 404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:57:04.574758 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-2d7af5b2-4721-4b50-84d8-57a63d49c6b0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:57:04.576561 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:57:04.576561 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: warnings.warn(msg) Dec 15 12:57:04.613383 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-2d7af5b2-4721-4b50-84d8-57a63d49c6b0 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042704 Dec 15 12:57:04.614455 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 4/9] 10.222.0.57 () {64 vars in 1335 bytes} [Wed Dec 15 12:57:04 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:07.010361 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-e64311b6-9d72-443d-bf60-36fea7ec7fb8 admin admin] Calling method '>' {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:07.010361 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-e64311b6-9d72-443d-bf60-36fea7ec7fb8 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Dec 15 12:57:07.017038 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 6/10] 10.222.0.57 () {54 vars in 930 bytes} [Wed Dec 15 12:57:07 2021] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:57:07.076034 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-b01a2795-12de-4638-a7c9-b1c0831e9365 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "disk": 10, "name": "ds1G", "vcpus": 1, "swap": 0, "ram": 1024, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:57:07.096326 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-b01a2795-12de-4638-a7c9-b1c0831e9365 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079949 Dec 15 12:57:07.096860 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 5/11] 10.222.0.57 () {64 vars in 1282 bytes} [Wed Dec 15 12:57:07 2021] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:57:07.108696 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-94026837-1f61-416c-bc30-39a1b2365f30 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:57:07.132295 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-94026837-1f61-416c-bc30-39a1b2365f30 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027195 Dec 15 12:57:07.133745 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 7/12] 10.222.0.57 () {64 vars in 1335 bytes} [Wed Dec 15 12:57:07 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:09.548216 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-b01a2795-12de-4638-a7c9-b1c0831e9365 admin admin] Calling method '>' {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:09.549224 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-b01a2795-12de-4638-a7c9-b1c0831e9365 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Dec 15 12:57:09.549782 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 6/13] 10.222.0.57 () {54 vars in 930 bytes} [Wed Dec 15 12:57:09 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:57:09.607662 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-1903a19a-a4a3-4560-a01f-5fd6f0085ea5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "rxtx_factor": 1.0, "disk": 10, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "ram": 2048, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:57:09.625409 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-1903a19a-a4a3-4560-a01f-5fd6f0085ea5 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.069558 Dec 15 12:57:09.626065 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 8/14] 10.222.0.57 () {64 vars in 1282 bytes} [Wed Dec 15 12:57:09 2021] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:57:09.638121 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-fd3d3899-d99a-4ab2-b2e4-8b3966887d04 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:57:09.661117 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-fd3d3899-d99a-4ab2-b2e4-8b3966887d04 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026702 Dec 15 12:57:09.661843 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 7/15] 10.222.0.57 () {64 vars in 1335 bytes} [Wed Dec 15 12:57:09 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:57:12.045041 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-1903a19a-a4a3-4560-a01f-5fd6f0085ea5 admin admin] Calling method '>' {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:12.046053 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-1903a19a-a4a3-4560-a01f-5fd6f0085ea5 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Dec 15 12:57:12.046754 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 9/16] 10.222.0.57 () {54 vars in 930 bytes} [Wed Dec 15 12:57:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:57:12.106595 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-b9fe2486-dc22-441e-ad5e-b5b4c6376bfb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "name": "ds4G", "swap": 0, "vcpus": 4, "disk": 20}} {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:57:12.125994 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-b9fe2486-dc22-441e-ad5e-b5b4c6376bfb admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072784 Dec 15 12:57:12.130680 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 8/17] 10.222.0.57 () {64 vars in 1282 bytes} [Wed Dec 15 12:57:12 2021] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:57:12.139295 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-368a7db5-f30f-453c-aa5c-1101e7003ecd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:57:12.162514 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-368a7db5-f30f-453c-aa5c-1101e7003ecd admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026725 Dec 15 12:57:12.163080 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 10/18] 10.222.0.57 () {64 vars in 1335 bytes} [Wed Dec 15 12:57:12 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:14.589665 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-b9fe2486-dc22-441e-ad5e-b5b4c6376bfb admin admin] Calling method '>' {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:14.590701 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-b9fe2486-dc22-441e-ad5e-b5b4c6376bfb admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Dec 15 12:57:14.591156 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 9/19] 10.222.0.57 () {54 vars in 930 bytes} [Wed Dec 15 12:57:14 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:57:14.649028 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-57616927-bd86-4557-8992-2bba209798d1 admin admin] Calling method '>' {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:14.672647 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-57616927-bd86-4557-8992-2bba209798d1 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.075202 Dec 15 12:57:14.673245 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 11/20] 10.222.0.57 () {60 vars in 1291 bytes} [Wed Dec 15 12:57:14 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:57:17.061069 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-b9fe2486-dc22-441e-ad5e-b5b4c6376bfb admin admin] Calling method '>' {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:17.062164 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-b9fe2486-dc22-441e-ad5e-b5b4c6376bfb admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Dec 15 12:57:17.062572 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 10/21] 10.222.0.57 () {54 vars in 930 bytes} [Wed Dec 15 12:57:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:57:17.129116 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-b2336ae8-7802-4858-8d41-13458c7fa619 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "disk": 1, "swap": 0, "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:57:17.152098 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-b2336ae8-7802-4858-8d41-13458c7fa619 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.082679 Dec 15 12:57:17.153063 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 12/22] 10.222.0.57 () {64 vars in 1282 bytes} [Wed Dec 15 12:57:17 2021] POST /compute/v2.1/flavors => generated 402 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:57:17.165362 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-46e8fe9e-6c86-4e8e-ba4b-3c962a054640 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:57:17.190374 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-46e8fe9e-6c86-4e8e-ba4b-3c962a054640 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028598 Dec 15 12:57:17.190938 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 11/23] 10.222.0.57 () {64 vars in 1332 bytes} [Wed Dec 15 12:57:17 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:20.177880 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-b2336ae8-7802-4858-8d41-13458c7fa619 admin admin] Calling method '>' {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:20.178945 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-b2336ae8-7802-4858-8d41-13458c7fa619 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Dec 15 12:57:20.179348 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 13/24] 10.222.0.57 () {54 vars in 930 bytes} [Wed Dec 15 12:57:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:57:20.238024 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-0c70afb4-e6ce-4074-8f59-049fbf758561 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20, "ram": 2048, "vcpus": 1, "name": "m1.small", "id": "2"}} {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:57:20.255151 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-0c70afb4-e6ce-4074-8f59-049fbf758561 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.068950 Dec 15 12:57:20.255702 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 12/25] 10.222.0.57 () {64 vars in 1282 bytes} [Wed Dec 15 12:57:20 2021] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:57:20.267585 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-5a0b20f7-42a1-47cb-afc5-7e647bceea9e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:57:20.288516 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-5a0b20f7-42a1-47cb-afc5-7e647bceea9e admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024507 Dec 15 12:57:20.289053 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 14/26] 10.222.0.57 () {64 vars in 1332 bytes} [Wed Dec 15 12:57:20 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:22.654789 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-0c70afb4-e6ce-4074-8f59-049fbf758561 admin admin] Calling method '>' {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:22.655787 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-0c70afb4-e6ce-4074-8f59-049fbf758561 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Dec 15 12:57:22.656183 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 13/27] 10.222.0.57 () {54 vars in 930 bytes} [Wed Dec 15 12:57:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:57:22.713739 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-0750af43-162b-4bce-80d2-a5f2aa8b7e03 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "m1.medium", "disk": 40, "os-flavor-access:is_public": true, "id": "3", "rxtx_factor": 1.0}} {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:57:22.735080 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-0750af43-162b-4bce-80d2-a5f2aa8b7e03 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.072419 Dec 15 12:57:22.735626 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 15/28] 10.222.0.57 () {64 vars in 1282 bytes} [Wed Dec 15 12:57:22 2021] POST /compute/v2.1/flavors => generated 406 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:57:22.748242 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-1c2b1d87-a2be-4cf5-915e-c003fd69ca7f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:57:22.771632 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-1c2b1d87-a2be-4cf5-915e-c003fd69ca7f admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026921 Dec 15 12:57:22.772196 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 14/29] 10.222.0.57 () {64 vars in 1332 bytes} [Wed Dec 15 12:57:22 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:57:25.183730 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-0750af43-162b-4bce-80d2-a5f2aa8b7e03 admin admin] Calling method '>' {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:25.184825 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-0750af43-162b-4bce-80d2-a5f2aa8b7e03 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Dec 15 12:57:25.185531 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 16/30] 10.222.0.57 () {54 vars in 930 bytes} [Wed Dec 15 12:57:25 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:57:25.325708 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-0385fd9a-ccfb-4f68-ba18-e88907c90765 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 80, "name": "m1.large", "os-flavor-access:is_public": true, "ram": 8192, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "swap": 0}} {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:57:25.351809 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-0385fd9a-ccfb-4f68-ba18-e88907c90765 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.158739 Dec 15 12:57:25.352615 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 15/31] 10.222.0.57 () {64 vars in 1282 bytes} [Wed Dec 15 12:57:25 2021] POST /compute/v2.1/flavors => generated 405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:57:25.365680 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-bd534fdb-d6f9-469d-b3cd-92c595e44bb2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:57:25.389196 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-bd534fdb-d6f9-469d-b3cd-92c595e44bb2 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027645 Dec 15 12:57:25.389783 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 17/32] 10.222.0.57 () {64 vars in 1332 bytes} [Wed Dec 15 12:57:25 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:57:27.903612 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-0385fd9a-ccfb-4f68-ba18-e88907c90765 admin admin] Calling method '>' {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:27.904840 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-0385fd9a-ccfb-4f68-ba18-e88907c90765 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001679 Dec 15 12:57:27.905239 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 16/33] 10.222.0.57 () {54 vars in 930 bytes} [Wed Dec 15 12:57:27 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:57:27.969062 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-8e432ab7-188a-486c-bbf5-09799e1c14cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "swap": 0, "vcpus": 8, "ram": 16384, "rxtx_factor": 1.0, "disk": 160}} {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:57:27.986813 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-8e432ab7-188a-486c-bbf5-09799e1c14cf admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.075086 Dec 15 12:57:27.994271 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 18/34] 10.222.0.57 () {64 vars in 1282 bytes} [Wed Dec 15 12:57:27 2021] POST /compute/v2.1/flavors => generated 408 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:57:27.999491 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-977bf642-56cf-4277-9754-7e9d1622f269 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:57:28.025743 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-977bf642-56cf-4277-9754-7e9d1622f269 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029834 Dec 15 12:57:28.038489 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 17/35] 10.222.0.57 () {64 vars in 1332 bytes} [Wed Dec 15 12:57:27 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:57:48.724775 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-8e432ab7-188a-486c-bbf5-09799e1c14cf admin admin] Calling method '>' {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:48.725771 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-8e432ab7-188a-486c-bbf5-09799e1c14cf admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Dec 15 12:57:48.726191 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 19/36] 10.222.0.57 () {54 vars in 930 bytes} [Wed Dec 15 12:57:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:57:48.783863 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-52ca1bcb-a565-4c16-aafe-dd0a18143d0f admin admin] Calling method '>' {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:48.800498 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-52ca1bcb-a565-4c16-aafe-dd0a18143d0f admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067515 Dec 15 12:57:48.801014 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 18/37] 10.222.0.57 () {60 vars in 1291 bytes} [Wed Dec 15 12:57:48 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:57:50.373810 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-8e432ab7-188a-486c-bbf5-09799e1c14cf admin admin] Calling method '>' {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:50.374908 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-8e432ab7-188a-486c-bbf5-09799e1c14cf admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Dec 15 12:57:50.375304 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 20/38] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Dec 15 12:57:50 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:57:50.562232 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-d10c999d-79eb-4a75-891d-fa8114f4bf37 admin admin] Calling method '>' {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:50.567625 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.wsgi [None req-d10c999d-79eb-4a75-891d-fa8114f4bf37 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 15 12:57:50.568183 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-d10c999d-79eb-4a75-891d-fa8114f4bf37 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 12:57:50.568961 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-d10c999d-79eb-4a75-891d-fa8114f4bf37 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.056929 Dec 15 12:57:50.569458 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 19/39] 10.222.0.57 () {60 vars in 1190 bytes} [Wed Dec 15 12:57:50 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 12:57:50.579464 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-efbe4c22-f86f-40ca-9e1f-96d8916a9208 admin admin] Calling method '>' {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:50.599911 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-efbe4c22-f86f-40ca-9e1f-96d8916a9208 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023831 Dec 15 12:57:50.600372 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 21/40] 10.222.0.57 () {60 vars in 1210 bytes} [Wed Dec 15 12:57:50 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:57:50.610259 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-7a0d89f7-2a8e-452d-8109-6feb3794067a admin admin] Calling method '>' {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:50.631309 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-7a0d89f7-2a8e-452d-8109-6feb3794067a admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024577 Dec 15 12:57:50.631832 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 20/41] 10.222.0.57 () {60 vars in 1210 bytes} [Wed Dec 15 12:57:50 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:57:50.642044 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-f29ecd1f-ff6b-4258-862f-6bbd4b8d0812 admin admin] Calling method '>' {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:50.647413 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.wsgi [None req-f29ecd1f-ff6b-4258-862f-6bbd4b8d0812 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 15 12:57:50.647978 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-f29ecd1f-ff6b-4258-862f-6bbd4b8d0812 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101912) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 12:57:50.648760 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-f29ecd1f-ff6b-4258-862f-6bbd4b8d0812 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010186 Dec 15 12:57:50.649248 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 22/42] 10.222.0.57 () {60 vars in 1190 bytes} [Wed Dec 15 12:57:50 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 12:57:52.208442 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-7a0d89f7-2a8e-452d-8109-6feb3794067a admin admin] Calling method '>' {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:52.209438 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-7a0d89f7-2a8e-452d-8109-6feb3794067a admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Dec 15 12:57:52.209828 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 21/43] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Dec 15 12:57:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:57:52.399187 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-a128ec81-e871-49de-9389-5ad317acef89 admin admin] Calling method '>' {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:52.404571 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.wsgi [None req-a128ec81-e871-49de-9389-5ad317acef89 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 15 12:57:52.405121 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-a128ec81-e871-49de-9389-5ad317acef89 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101912) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 12:57:52.405890 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-a128ec81-e871-49de-9389-5ad317acef89 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058260 Dec 15 12:57:52.406488 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 23/44] 10.222.0.57 () {60 vars in 1190 bytes} [Wed Dec 15 12:57:52 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 12:57:52.416052 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-99ebdb36-aab4-4017-a91c-8902ba617aeb admin admin] Calling method '>' {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:52.429316 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-99ebdb36-aab4-4017-a91c-8902ba617aeb admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016719 Dec 15 12:57:52.429771 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 22/45] 10.222.0.57 () {60 vars in 1210 bytes} [Wed Dec 15 12:57:52 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:57:52.440104 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-6e9f0622-e14d-4684-8c38-efde7abf8e2f admin admin] Calling method '>' {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:52.454380 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-6e9f0622-e14d-4684-8c38-efde7abf8e2f admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017897 Dec 15 12:57:52.454900 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 24/46] 10.222.0.57 () {60 vars in 1210 bytes} [Wed Dec 15 12:57:52 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:57:52.464791 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-6529375d-d4c9-4f26-b778-dc6e7e65cbfd admin admin] Calling method '>' {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:52.469781 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.wsgi [None req-6529375d-d4c9-4f26-b778-dc6e7e65cbfd admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 15 12:57:52.470439 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-6529375d-d4c9-4f26-b778-dc6e7e65cbfd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 12:57:52.471208 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-6529375d-d4c9-4f26-b778-dc6e7e65cbfd admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010121 Dec 15 12:57:52.471686 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 23/47] 10.222.0.57 () {60 vars in 1190 bytes} [Wed Dec 15 12:57:52 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 12:57:53.957843 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-6e9f0622-e14d-4684-8c38-efde7abf8e2f admin admin] Calling method '>' {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:53.958858 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-6e9f0622-e14d-4684-8c38-efde7abf8e2f admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Dec 15 12:57:53.959298 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 25/48] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Dec 15 12:57:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:57:54.154188 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-fa6b3af2-a99c-4f06-9e7b-c4dabb3385a7 admin admin] Calling method '>' {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:54.159325 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.wsgi [None req-fa6b3af2-a99c-4f06-9e7b-c4dabb3385a7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 15 12:57:54.159881 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-fa6b3af2-a99c-4f06-9e7b-c4dabb3385a7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 12:57:54.160656 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-fa6b3af2-a99c-4f06-9e7b-c4dabb3385a7 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.056532 Dec 15 12:57:54.161146 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 24/49] 10.222.0.57 () {60 vars in 1193 bytes} [Wed Dec 15 12:57:54 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 12:57:54.171159 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-e46714e4-2ca9-4bd9-9bab-2fc5cabb0f28 admin admin] Calling method '>' {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:54.184730 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-e46714e4-2ca9-4bd9-9bab-2fc5cabb0f28 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017028 Dec 15 12:57:54.185238 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 26/50] 10.222.0.57 () {60 vars in 1210 bytes} [Wed Dec 15 12:57:54 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:57:54.196308 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-ca10f035-6bc2-4e7b-bb5d-abc3cf091ef4 admin admin] Calling method '>' {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:54.208977 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-ca10f035-6bc2-4e7b-bb5d-abc3cf091ef4 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017637 Dec 15 12:57:54.209497 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 25/51] 10.222.0.57 () {60 vars in 1210 bytes} [Wed Dec 15 12:57:54 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:57:54.219360 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-8fba03c9-9c4a-4b6f-b9d8-83219320dc05 admin admin] Calling method '>' {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:54.224467 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.wsgi [None req-8fba03c9-9c4a-4b6f-b9d8-83219320dc05 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 15 12:57:54.225015 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-8fba03c9-9c4a-4b6f-b9d8-83219320dc05 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101912) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 12:57:54.225780 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-8fba03c9-9c4a-4b6f-b9d8-83219320dc05 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010195 Dec 15 12:57:54.226302 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 27/52] 10.222.0.57 () {60 vars in 1193 bytes} [Wed Dec 15 12:57:54 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 12:57:55.716212 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-ca10f035-6bc2-4e7b-bb5d-abc3cf091ef4 admin admin] Calling method '>' {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:55.717210 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-ca10f035-6bc2-4e7b-bb5d-abc3cf091ef4 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Dec 15 12:57:55.717642 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 26/53] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Dec 15 12:57:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:57:55.908982 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-0ecd2ff5-d8a5-480f-bce9-0d489f155a3c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:57:55.927529 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-0ecd2ff5-d8a5-480f-bce9-0d489f155a3c admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069173 Dec 15 12:57:55.927990 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 28/54] 10.222.0.57 () {64 vars in 1235 bytes} [Wed Dec 15 12:57:55 2021] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:57:57.392102 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-ca10f035-6bc2-4e7b-bb5d-abc3cf091ef4 admin admin] Calling method '>' {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:57.393082 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-ca10f035-6bc2-4e7b-bb5d-abc3cf091ef4 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001387 Dec 15 12:57:57.393473 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 27/55] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Dec 15 12:57:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:57:57.582636 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-63b5def0-1a47-4797-a5eb-f58f59e57883 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:57:57.599965 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-63b5def0-1a47-4797-a5eb-f58f59e57883 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067419 Dec 15 12:57:57.600497 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 29/56] 10.222.0.57 () {64 vars in 1235 bytes} [Wed Dec 15 12:57:57 2021] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:57:59.065995 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-ca10f035-6bc2-4e7b-bb5d-abc3cf091ef4 admin admin] Calling method '>' {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:59.067026 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-ca10f035-6bc2-4e7b-bb5d-abc3cf091ef4 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Dec 15 12:57:59.067416 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 28/57] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Dec 15 12:57:59 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:57:59.255347 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-9f34da81-b794-4ac8-b5e4-d612605ae4a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:57:59.274357 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-9f34da81-b794-4ac8-b5e4-d612605ae4a6 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.070046 Dec 15 12:57:59.275393 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 30/58] 10.222.0.57 () {64 vars in 1235 bytes} [Wed Dec 15 12:57:59 2021] POST /compute/v2.1/flavors => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:58:00.794660 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-ca10f035-6bc2-4e7b-bb5d-abc3cf091ef4 admin admin] Calling method '>' {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:00.795652 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-ca10f035-6bc2-4e7b-bb5d-abc3cf091ef4 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Dec 15 12:58:00.796045 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 29/59] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Dec 15 12:58:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:58:00.986931 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-53ec3409-650b-4b94-9b4b-9e33bd54177c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:58:01.005590 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-53ec3409-650b-4b94-9b4b-9e33bd54177c admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069820 Dec 15 12:58:01.006072 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 31/60] 10.222.0.57 () {64 vars in 1235 bytes} [Wed Dec 15 12:58:00 2021] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:58:02.486260 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-ca10f035-6bc2-4e7b-bb5d-abc3cf091ef4 admin admin] Calling method '>' {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:02.487287 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-ca10f035-6bc2-4e7b-bb5d-abc3cf091ef4 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Dec 15 12:58:02.487677 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 30/61] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Dec 15 12:58:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:58:02.678912 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-8436f980-1cfe-458b-9759-a216f5e432c9 admin admin] Calling method '>' {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:02.699266 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-8436f980-1cfe-458b-9759-a216f5e432c9 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071263 Dec 15 12:58:02.699799 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 32/62] 10.222.0.57 () {60 vars in 1202 bytes} [Wed Dec 15 12:58:02 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:58:50.210384 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-ca10f035-6bc2-4e7b-bb5d-abc3cf091ef4 admin admin] Calling method '>' {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:50.211504 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-ca10f035-6bc2-4e7b-bb5d-abc3cf091ef4 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001669 Dec 15 12:58:50.211953 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 31/63] 10.222.0.57 () {54 vars in 930 bytes} [Wed Dec 15 12:58:50 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:58:50.269925 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-84da64f8-c061-4f5e-b437-da4a7198e4fe admin admin] Calling method '>' {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:50.288910 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-84da64f8-c061-4f5e-b437-da4a7198e4fe admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070458 Dec 15 12:58:50.289976 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 33/64] 10.222.0.57 () {60 vars in 1291 bytes} [Wed Dec 15 12:58:50 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:58:50.312310 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-be5d5589-58a5-4087-a7dc-940776d8f6ee admin admin] Calling method '>' {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:50.319836 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-be5d5589-58a5-4087-a7dc-940776d8f6ee admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011049 Dec 15 12:58:50.320359 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 32/65] 10.222.0.57 () {60 vars in 1282 bytes} [Wed Dec 15 12:58:50 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:50.332601 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-71100dd3-db91-4c20-9c2d-80138bbec966 admin admin] Calling method '>' {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:50.340435 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-71100dd3-db91-4c20-9c2d-80138bbec966 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011415 Dec 15 12:58:50.340976 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 34/66] 10.222.0.57 () {60 vars in 1285 bytes} [Wed Dec 15 12:58:50 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:58:50.353573 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-5cf28435-5c3c-4688-a518-7567a6cd176a admin admin] Calling method '>' {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:50.361202 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-5cf28435-5c3c-4688-a518-7567a6cd176a admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011686 Dec 15 12:58:50.361721 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 33/67] 10.222.0.57 () {60 vars in 1285 bytes} [Wed Dec 15 12:58:50 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:50.374088 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-1794abbf-57f2-4cfd-a921-61678e6ee9a8 admin admin] Calling method '>' {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:50.381638 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-1794abbf-57f2-4cfd-a921-61678e6ee9a8 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011074 Dec 15 12:58:50.382177 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 35/68] 10.222.0.57 () {60 vars in 1282 bytes} [Wed Dec 15 12:58:50 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:00:28.835078 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-91955131-d4f3-4488-a772-da4371a59ebe tempest-verify_tempest_config-1894640791 tempest-verify_tempest_config-1894640791-project] Calling method '>' {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:00:28.837213 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-91955131-d4f3-4488-a772-da4371a59ebe tempest-verify_tempest_config-1894640791 tempest-verify_tempest_config-1894640791-project] 10.222.0.57 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.112757 Dec 15 13:00:28.837734 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 34/69] 10.222.0.57 () {58 vars in 1133 bytes} [Wed Dec 15 13:00:28 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:02:01.179550 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-1794abbf-57f2-4cfd-a921-61678e6ee9a8 admin admin] Calling method '>' {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:01.180544 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-1794abbf-57f2-4cfd-a921-61678e6ee9a8 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Dec 15 13:02:01.180934 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 36/70] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Dec 15 13:02:01 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:02:01.432610 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-acc2b7fd-2260-4630-9636-7330e848dcaf admin admin] Calling method '>' {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:01.433769 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:02:01.433769 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: warnings.warn(msg) Dec 15 13:02:01.435346 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG oslo_concurrency.lockutils [None req-acc2b7fd-2260-4630-9636-7330e848dcaf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:01.435788 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG oslo_concurrency.lockutils [None req-acc2b7fd-2260-4630-9636-7330e848dcaf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:01.436587 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG oslo_concurrency.lockutils [None req-acc2b7fd-2260-4630-9636-7330e848dcaf admin admin] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:01.437049 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG oslo_concurrency.lockutils [None req-acc2b7fd-2260-4630-9636-7330e848dcaf admin admin] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:01.470339 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-acc2b7fd-2260-4630-9636-7330e848dcaf admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.148850 Dec 15 13:02:01.470889 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 35/71] 10.222.0.57 () {60 vars in 1193 bytes} [Wed Dec 15 13:02:01 2021] GET /compute/v2.1/os-services => generated 791 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:02:02.958735 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-1794abbf-57f2-4cfd-a921-61678e6ee9a8 admin admin] Calling method '>' {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:02.959730 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-1794abbf-57f2-4cfd-a921-61678e6ee9a8 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Dec 15 13:02:02.960382 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 37/72] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Dec 15 13:02:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:02:03.149387 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-1a253741-f42d-47b3-8ed1-09880678af06 admin admin] Calling method '>' {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:03.150845 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:02:03.150845 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: warnings.warn(msg) Dec 15 13:02:03.152337 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG oslo_concurrency.lockutils [None req-1a253741-f42d-47b3-8ed1-09880678af06 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:03.152771 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG oslo_concurrency.lockutils [None req-1a253741-f42d-47b3-8ed1-09880678af06 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:03.153565 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG oslo_concurrency.lockutils [None req-1a253741-f42d-47b3-8ed1-09880678af06 admin admin] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:03.153984 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG oslo_concurrency.lockutils [None req-1a253741-f42d-47b3-8ed1-09880678af06 admin admin] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:03.177947 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-1a253741-f42d-47b3-8ed1-09880678af06 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078488 Dec 15 13:02:03.178509 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 36/73] 10.222.0.57 () {60 vars in 1193 bytes} [Wed Dec 15 13:02:03 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:02:15.071109 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-1794abbf-57f2-4cfd-a921-61678e6ee9a8 admin admin] Calling method '>' {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:15.072518 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-1794abbf-57f2-4cfd-a921-61678e6ee9a8 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Dec 15 13:02:15.072518 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 38/74] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Dec 15 13:02:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:02:15.268607 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-a4a834fa-a381-4723-96ae-94df2dc5b2cd admin admin] Calling method '>' {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:15.269832 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:02:15.269832 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: warnings.warn(msg) Dec 15 13:02:15.271370 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG oslo_concurrency.lockutils [None req-a4a834fa-a381-4723-96ae-94df2dc5b2cd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:15.271806 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG oslo_concurrency.lockutils [None req-a4a834fa-a381-4723-96ae-94df2dc5b2cd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:15.272592 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG oslo_concurrency.lockutils [None req-a4a834fa-a381-4723-96ae-94df2dc5b2cd admin admin] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:15.273015 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG oslo_concurrency.lockutils [None req-a4a834fa-a381-4723-96ae-94df2dc5b2cd admin admin] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:15.294428 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-a4a834fa-a381-4723-96ae-94df2dc5b2cd admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080422 Dec 15 13:02:15.294959 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 37/75] 10.222.0.57 () {60 vars in 1193 bytes} [Wed Dec 15 13:02:15 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:02:16.826726 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: DEBUG nova.api.openstack.wsgi [None req-1794abbf-57f2-4cfd-a921-61678e6ee9a8 admin admin] Calling method '>' {{(pid=101912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:16.827724 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: INFO nova.api.openstack.requestlog [None req-1794abbf-57f2-4cfd-a921-61678e6ee9a8 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Dec 15 13:02:16.828117 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: [pid: 101912|app: 0|req: 39/76] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Dec 15 13:02:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:02:17.018437 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG nova.api.openstack.wsgi [None req-d417f20e-bc54-4b79-997b-e6eaf5a62557 admin admin] Calling method '>' {{(pid=101911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:17.019613 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:02:17.019613 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: warnings.warn(msg) Dec 15 13:02:17.021138 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG oslo_concurrency.lockutils [None req-d417f20e-bc54-4b79-997b-e6eaf5a62557 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:17.021582 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG oslo_concurrency.lockutils [None req-d417f20e-bc54-4b79-997b-e6eaf5a62557 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:17.022392 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG oslo_concurrency.lockutils [None req-d417f20e-bc54-4b79-997b-e6eaf5a62557 admin admin] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:17.022822 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: DEBUG oslo_concurrency.lockutils [None req-d417f20e-bc54-4b79-997b-e6eaf5a62557 admin admin] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:17.043457 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: INFO nova.api.openstack.requestlog [None req-d417f20e-bc54-4b79-997b-e6eaf5a62557 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.075437 Dec 15 13:02:17.043924 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: [pid: 101911|app: 0|req: 38/77] 10.222.0.57 () {60 vars in 1193 bytes} [Wed Dec 15 13:02:16 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:03:14.855055 dv-cinder-813226-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 15 13:03:14.855595 dv-cinder-813226-4-iscsi devstack@n-api.service[101910]: Wed Dec 15 13:03:14 2021 - graceful shutdown triggered... Dec 15 13:03:14.856049 dv-cinder-813226-4-iscsi devstack@n-api.service[101912]: Gracefully killing worker 2 (pid: 101912)... Dec 15 13:03:14.856413 dv-cinder-813226-4-iscsi devstack@n-api.service[101911]: Gracefully killing worker 1 (pid: 101911)... Dec 15 13:03:15.856738 dv-cinder-813226-4-iscsi devstack@n-api.service[101910]: worker 1 buried after 1 seconds Dec 15 13:03:15.857192 dv-cinder-813226-4-iscsi devstack@n-api.service[101910]: worker 2 buried after 1 seconds Dec 15 13:03:15.857192 dv-cinder-813226-4-iscsi devstack@n-api.service[101910]: goodbye to uWSGI. Dec 15 13:03:15.858346 dv-cinder-813226-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Dec 15 13:03:15.858909 dv-cinder-813226-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 15 13:03:15.861712 dv-cinder-813226-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 15 13:03:15.871198 dv-cinder-813226-4-iscsi devstack@n-api.service[116078]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 15 13:03:15.873200 dv-cinder-813226-4-iscsi devstack@n-api.service[116078]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 15 13:03:15 2021] *** Dec 15 13:03:15.873200 dv-cinder-813226-4-iscsi devstack@n-api.service[116078]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 15 13:03:15.873200 dv-cinder-813226-4-iscsi devstack@n-api.service[116078]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 15 13:03:15.873200 dv-cinder-813226-4-iscsi devstack@n-api.service[116078]: nodename: dv-cinder-813226-4-iscsi Dec 15 13:03:15.873200 dv-cinder-813226-4-iscsi devstack@n-api.service[116078]: machine: x86_64 Dec 15 13:03:15.873200 dv-cinder-813226-4-iscsi devstack@n-api.service[116078]: clock source: unix Dec 15 13:03:15.873200 dv-cinder-813226-4-iscsi devstack@n-api.service[116078]: pcre jit disabled Dec 15 13:03:15.873200 dv-cinder-813226-4-iscsi devstack@n-api.service[116078]: detected number of CPU cores: 4 Dec 15 13:03:15.873200 dv-cinder-813226-4-iscsi devstack@n-api.service[116078]: current working directory: / Dec 15 13:03:15.873200 dv-cinder-813226-4-iscsi devstack@n-api.service[116078]: detected binary path: /usr/bin/uwsgi-core Dec 15 13:03:15.873200 dv-cinder-813226-4-iscsi devstack@n-api.service[116078]: your processes number limit is 47680 Dec 15 13:03:15.873913 dv-cinder-813226-4-iscsi devstack@n-api.service[116078]: your memory page size is 4096 bytes Dec 15 13:03:15.873913 dv-cinder-813226-4-iscsi devstack@n-api.service[116078]: detected max file descriptor number: 2048 Dec 15 13:03:15.873913 dv-cinder-813226-4-iscsi devstack@n-api.service[116078]: lock engine: pthread robust mutexes Dec 15 13:03:15.873913 dv-cinder-813226-4-iscsi devstack@n-api.service[116078]: thunder lock: enabled Dec 15 13:03:15.873913 dv-cinder-813226-4-iscsi devstack@n-api.service[116078]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 15 13:03:15.873913 dv-cinder-813226-4-iscsi devstack@n-api.service[116078]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 15 13:03:15.918912 dv-cinder-813226-4-iscsi devstack@n-api.service[116078]: Python main interpreter initialized at 0x56509b9669c0 Dec 15 13:03:15.918912 dv-cinder-813226-4-iscsi devstack@n-api.service[116078]: python threads support enabled Dec 15 13:03:15.918912 dv-cinder-813226-4-iscsi devstack@n-api.service[116078]: your server socket listen backlog is limited to 100 connections Dec 15 13:03:15.918912 dv-cinder-813226-4-iscsi devstack@n-api.service[116078]: your mercy for graceful operations on workers is 90 seconds Dec 15 13:03:15.919421 dv-cinder-813226-4-iscsi devstack@n-api.service[116078]: mapped 403077 bytes (393 KB) for 2 cores Dec 15 13:03:15.919421 dv-cinder-813226-4-iscsi devstack@n-api.service[116078]: *** Operational MODE: preforking *** Dec 15 13:03:15.919629 dv-cinder-813226-4-iscsi devstack@n-api.service[116078]: *** uWSGI is running in multiple interpreter mode *** Dec 15 13:03:15.919835 dv-cinder-813226-4-iscsi devstack@n-api.service[116078]: spawned uWSGI master process (pid: 116078) Dec 15 13:03:15.920175 dv-cinder-813226-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 15 13:03:15.923036 dv-cinder-813226-4-iscsi devstack@n-api.service[116078]: spawned uWSGI worker 1 (pid: 116097, cores: 1) Dec 15 13:03:15.923606 dv-cinder-813226-4-iscsi devstack@n-api.service[116078]: spawned uWSGI worker 2 (pid: 116098, cores: 1) Dec 15 13:03:15.923941 dv-cinder-813226-4-iscsi devstack@n-api.service[116078]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 15 13:03:17.810610 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 13:03:17.810610 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: from cryptography.utils import int_from_bytes Dec 15 13:03:17.811234 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 13:03:17.811234 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: from cryptography.utils import int_from_bytes Dec 15 13:03:17.812717 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 13:03:17.812717 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: from cryptography.utils import int_from_bytes Dec 15 13:03:17.813246 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 13:03:17.813246 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: from cryptography.utils import int_from_bytes Dec 15 13:03:20.238522 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 13:03:20.239186 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 13:03:20.239278 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 13:03:20.239626 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 13:03:20.239885 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 13:03:20.240277 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.240608 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.240934 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.241258 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.241598 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.241908 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.242791 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.243064 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 13:03:20.243453 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.243537 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 13:03:20.243628 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.243710 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.244030 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 13:03:20.244141 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.244227 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 13:03:20.244324 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813226-4-iscsi {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.244418 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 13:03:20.244722 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.244832 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.244917 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.245194 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.245324 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.245409 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.245561 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.245837 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.246003 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.246264 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.246438 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.246594 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.246825 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.246825 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.248849 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.249104 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.249361 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.249573 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.249806 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.250061 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.250432 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.250671 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.250671 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813226-4-iscsi {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.251211 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.251211 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.251669 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.251898 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.252122 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.252330 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.252538 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.252776 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.253019 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.253243 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.253482 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.253662 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.253875 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.254024 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813226-4-iscsi {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.254245 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.254408 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.254408 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.254740 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.254908 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.255068 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.255068 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.255377 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.255531 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.255683 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.255828 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.255992 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.256145 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.256298 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.256455 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.256671 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.257498 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.257715 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.258393 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.258547 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.258703 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.258860 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.259016 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.259182 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.259182 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.259557 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813226-4-iscsi {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.260275 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.260443 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.260797 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.260961 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.261108 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.261321 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.261479 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.261603 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.261731 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.261989 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.262216 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.262520 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.262680 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.262887 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.263051 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.263205 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.263357 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.263513 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.263671 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.263830 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.264021 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.264176 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.264342 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.264342 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.264654 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.264814 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.264969 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.265114 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.265259 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.265465 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.265630 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.265784 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.265936 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.266119 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.266308 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.266455 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.266646 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.266807 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.267211 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.267211 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.267934 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.268123 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.268282 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.268453 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.268608 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.268793 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.268985 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.269154 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.269305 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.269462 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.269616 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.269768 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.269958 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.270123 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.270321 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.270475 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.270630 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.270819 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.271032 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.271194 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.271339 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.271483 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.271627 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.271781 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.271943 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.272128 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.272318 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.272467 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.272618 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.272770 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.272955 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.273115 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.273296 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.273706 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.273862 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.274010 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.274240 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.274401 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.274555 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.274711 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.274856 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.275045 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.275202 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.275354 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.275516 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.275662 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.275806 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.275968 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.276124 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.276342 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.276492 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.276637 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.276780 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.276938 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.277308 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.277861 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.278029 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.278217 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.278406 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.278570 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.278723 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.278877 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.279022 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.279177 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.279338 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.279338 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.279627 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.279772 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.279916 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.280085 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.280245 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.280245 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.280583 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.280729 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.280873 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.281018 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.281202 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.281367 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.281513 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.281666 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.281817 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.281961 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.282124 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.282370 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.282520 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.282675 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.282828 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.282988 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.283140 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.283285 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.283465 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.283629 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.283787 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.283942 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.284097 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.284253 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.284409 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.284615 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.284775 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.284933 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.285086 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.285272 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.285433 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.285589 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.285741 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.285887 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.286042 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.286227 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.286401 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.286555 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.286710 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.288195 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.288362 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.288511 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.288699 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.288881 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.289048 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.289203 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.289388 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.289552 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.289718 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.289875 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.290021 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.290221 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.290384 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.290540 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.290686 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.290841 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.290995 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.291148 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.291293 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.291448 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.291593 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.291754 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.291902 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.292047 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.292201 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.292346 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.292499 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.292652 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.292843 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.292991 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.293150 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.293303 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.293491 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.293662 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.293808 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.293955 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.294109 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.294290 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.294448 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.294601 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.294750 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.294903 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.295063 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.295218 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.295364 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.295509 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.295509 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.295809 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.295963 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.296110 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.296110 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.297126 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.297126 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.297700 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.298336 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.298503 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.298666 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.298814 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.298959 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:03:20.299129 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.299285 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.299431 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.299431 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.299713 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.299869 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.300016 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.300168 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.300327 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.300472 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.300617 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.300773 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.300947 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.301040 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.301133 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.301218 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.301308 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.301401 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.301527 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.301635 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.301736 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.301822 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.301913 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.301997 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.302093 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.302221 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.302321 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.302416 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.302502 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.302592 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.302686 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.302771 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.302855 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.302946 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.303089 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.303198 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.303285 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.303369 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.303451 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.303540 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.303625 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.303721 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.303817 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.303910 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.303994 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.304083 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.304174 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.304267 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.304363 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.304448 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.305050 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.305200 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.305287 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.305385 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.305471 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.305561 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.305645 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.305735 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.305828 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.305913 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.305996 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.306077 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.306176 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.306272 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.306371 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.306456 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.306541 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.306624 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.306713 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.306804 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.306897 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.306981 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.307064 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.307154 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.307238 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.307320 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.307412 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.307516 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.307765 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.307865 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.307983 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.308246 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.308364 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.308615 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.308708 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.308780 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.308848 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.308971 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.309070 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.309162 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.309162 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.309323 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.309414 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.309511 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.309673 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.309778 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.309873 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.309964 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.310059 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.310191 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.310291 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.310384 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.310475 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.310560 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.310657 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.310743 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.310826 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.310917 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.311008 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.311099 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.311099 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.311276 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.311367 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.311452 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.311534 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.311616 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.311713 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.311799 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.311893 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.311978 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.312062 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.312144 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.312236 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.312328 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.312412 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.312501 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.312585 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.312677 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.312763 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.312853 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.312944 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.313028 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.313111 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.313304 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.313399 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.313492 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.313584 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.313669 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.313751 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.313847 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.313933 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.314015 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.314098 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.314225 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.314315 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.314412 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.314498 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.314581 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.314672 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.314763 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.314858 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.314971 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.315115 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.315209 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.315301 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.315386 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.315483 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.315569 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.315652 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.315742 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.315833 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.315925 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.316023 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.316109 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.316192 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.316282 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.316367 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.316457 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.316558 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.316650 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.316742 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.316827 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.316918 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.317010 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.317107 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.317200 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.317284 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.317373 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.317465 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.317465 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.317759 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.317759 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.318045 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.318140 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.318334 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.318426 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.318507 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.318749 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.318849 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.318935 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.319027 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.319126 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.319219 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.319312 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.319397 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.319480 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.319563 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.319655 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.319741 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.319741 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.319893 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.319983 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.320081 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.320225 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.320817 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.320915 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.321001 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.321091 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.321187 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.321316 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.321407 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.321501 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.321595 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.321680 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.321777 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.321943 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.322045 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.322302 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.322400 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.322611 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.322717 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.322927 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.323028 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.323239 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.323332 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.323566 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.323674 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.323880 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.324204 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.324512 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.324680 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.324852 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.325006 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.325158 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.325318 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.325480 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.325642 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.325804 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.325965 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.326124 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.326358 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.326518 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.326695 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.326859 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.327026 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.327188 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.327341 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.327493 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.327646 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.327807 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.327979 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.328209 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.328375 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.328531 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.328715 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.329047 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.329207 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.329369 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.329522 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.329676 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.329842 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.329995 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.330180 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.330350 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.330504 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.330657 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.330819 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.330992 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.331154 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.331308 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.331405 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.331487 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.331573 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.331645 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.331720 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.331812 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.331897 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.332018 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.332137 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.332379 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.332494 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.332697 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.332791 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.333055 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.333159 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.333367 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.333462 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.333676 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.333781 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.333989 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.334257 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.334431 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.334662 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.334765 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.334980 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.335180 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.335345 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.335488 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.335635 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.335830 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.335942 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.336143 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.336237 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.336452 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.336553 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.336769 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.336876 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.337100 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.337220 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.337418 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.337541 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.337744 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.337859 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.338053 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.338195 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.338392 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.338505 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.338700 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.338818 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.339015 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.339127 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.339326 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.339427 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.339633 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.339763 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.339969 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.340101 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.340241 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.340336 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.340553 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.340654 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.340861 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.340964 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.341251 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.341393 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.341483 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.341556 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.341797 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.342070 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.342255 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.342443 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.342551 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.342770 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.342873 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.343099 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.343201 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.343419 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.343520 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.343738 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.343853 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.344045 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.344146 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.344358 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.344452 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.344670 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.344771 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.344981 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.345077 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.345378 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.345490 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.345607 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.345700 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.345913 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.346012 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.346249 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.346345 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.346563 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.346664 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.346868 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.347026 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.347174 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.347273 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.347489 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.347589 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.347794 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.348066 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.348216 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.348406 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.348507 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.348726 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.348821 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.349043 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.349142 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.349354 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.349460 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.349668 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.349781 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.349977 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.350079 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.350330 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.350447 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.350644 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.350746 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.350950 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.351043 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.351259 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.351641 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.351641 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.351933 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.352080 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.352224 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.352368 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.352520 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.352671 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.352814 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.352972 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.353122 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.353277 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.353452 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.353673 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.353814 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.353954 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.354096 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.354295 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.354393 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.354473 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.354558 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.354643 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.354753 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.355034 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.355136 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.355342 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.355444 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.355657 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.356354 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.356671 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.356840 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.356995 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.357159 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.357313 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.357465 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.357634 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.357796 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.357962 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.358129 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.358326 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.358570 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.358730 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.358891 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.359046 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.359230 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.359331 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.359419 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.359683 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.359953 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.360261 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.360541 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.360710 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.360873 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.361028 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.361181 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.361348 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.361519 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.361815 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.361918 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.362005 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.362129 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.362303 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.362487 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.362592 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.362806 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.362901 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.363135 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.363251 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.363453 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.363552 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.363769 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.363869 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.364083 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.364181 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.364390 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.364483 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.364700 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.364801 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.365004 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.365104 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.365320 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.365413 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.365631 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.365729 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.365935 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.366029 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.366259 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.366371 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.366572 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.366666 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.366879 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.367478 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.367698 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.367792 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.368010 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.368104 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.368315 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.368409 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.368635 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.368740 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.369001 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.369152 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.369249 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.369342 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.369529 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.369647 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.369844 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.369961 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.370162 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.370257 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.370477 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.370569 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.370785 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.370887 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.371094 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.371195 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.371395 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.371493 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.371700 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.371940 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.372071 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.372185 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.372301 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.372392 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.372603 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.372706 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.372911 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.373011 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.373222 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.373315 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.373531 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.373626 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.373831 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.373923 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.374159 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.374267 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.374469 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.374565 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.374775 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.374867 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.375079 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.375182 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.375387 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.375481 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.375691 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.375783 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.375993 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.376100 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.376294 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.376387 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.376598 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.376702 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.376902 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.377009 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.377223 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.377316 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.377531 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.377631 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.377835 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.377938 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.378185 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.378284 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.378462 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.378555 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.378814 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.378923 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.379135 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.379230 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.379447 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.379538 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.379775 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.379884 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.380095 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.380232 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.380404 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.380561 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.380726 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.380883 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.381026 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.381121 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.381319 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.381468 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.381628 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.381785 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.381952 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.382089 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.382247 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.382417 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.382577 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.383326 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.383484 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.383635 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.383783 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.383932 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.384081 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.384176 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.384328 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.384477 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.384644 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.384797 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.384959 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.385101 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.385269 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.385422 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.385582 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.385785 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.385924 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.386099 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.386216 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.386514 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.386825 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.387148 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.387460 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.387806 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.387891 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.388135 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.388232 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.388456 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.388548 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.388775 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.388864 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.389479 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.389598 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.389674 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.389745 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.389815 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.389883 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.390243 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.390362 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.390437 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.390514 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.390666 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.390781 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.390977 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.391102 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.391292 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.391422 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.391605 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.391739 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.391912 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.392148 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.392253 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.392356 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.392561 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.392657 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.392836 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.392990 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.393146 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.393299 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.393454 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.393609 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.393769 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.393919 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.394258 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.394368 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.394577 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.394677 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.394919 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.395011 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.395209 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.395310 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.395515 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.395625 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.395830 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.395923 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.396145 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.396314 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.396465 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.396630 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.396784 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.396946 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.397090 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.397273 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.397510 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.397613 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.397829 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.397923 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.398186 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.398370 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.398816 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.398920 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.399134 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.399249 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.399458 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.399556 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.399785 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.399888 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.400102 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.400217 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.400477 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.400582 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.400680 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.400772 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.400988 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.401080 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.401311 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.401411 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.401616 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.401710 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.401941 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.402044 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.402387 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.402497 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.402717 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.402859 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.403036 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.403154 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.403364 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.403545 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.403696 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.403858 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.403998 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.404171 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.404299 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.404496 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.404617 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.404818 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.404919 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.405197 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.405294 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.405535 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.405638 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.405844 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.405936 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.406601 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.406736 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.406736 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.406991 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.407082 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.407082 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.407283 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.407388 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.407621 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.407725 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.407941 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.408044 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.408249 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.408352 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.408574 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.408668 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.408908 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.409068 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.409213 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.409371 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.409516 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.409656 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.409839 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.410039 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.410135 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.410482 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.410796 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.410975 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.411103 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.411211 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.411450 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.411551 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.411757 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.411930 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.412085 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.412229 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.412415 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.412553 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.412725 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.412912 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.413036 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.413264 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.413592 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.413693 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.413779 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.413931 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.414178 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.414277 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.414376 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.414586 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.414680 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.414901 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.415011 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.415211 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.415335 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.415517 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.415618 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.415823 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.415925 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.416133 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.416226 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.416434 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.416525 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.416746 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.416840 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.417053 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.417146 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.417358 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.417486 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.417661 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.417756 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.417973 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.418067 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.418303 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.418411 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.418617 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.418711 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.418927 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.419027 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.419233 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.419325 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.419534 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.419634 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.419838 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.419938 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.420167 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.420272 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.420481 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.420636 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.420808 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.420902 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.421132 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.421239 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.421440 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.421649 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.421799 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.421925 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.422084 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.422278 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.422413 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.422690 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.422808 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.422995 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.423084 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.423277 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.423490 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.423616 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.423705 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.423921 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.424095 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.424226 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.424415 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.424527 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.424705 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.424827 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.425031 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.425125 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.425349 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.425450 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.425674 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.425775 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.425998 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.426099 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.426341 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.426448 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.426647 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.426915 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.427024 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.427254 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.427405 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.427556 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.427649 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.427861 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.427957 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.428165 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.428336 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.428497 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.428590 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.428799 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.428899 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.429131 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.429224 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.429448 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.430098 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.430315 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.430412 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.430638 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.430773 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.430961 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.431096 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.431289 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.431398 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.431608 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.431704 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.431928 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.432047 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.432246 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.432349 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.432568 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.432671 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.432879 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.432986 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.433197 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.433404 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.433550 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.433692 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.433853 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.434002 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.434247 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.434413 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.434522 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.434618 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.434744 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.434892 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.435108 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.435302 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.435426 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.435633 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.435735 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.435948 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.436041 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.436333 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.436443 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.436642 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.436794 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.437672 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.437826 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.437943 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.438064 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.438234 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.438356 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.438469 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.438591 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.438705 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.438827 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.438827 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.439054 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.439054 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.439284 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.439485 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.439644 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.439776 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.439899 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.439899 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.440120 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.440243 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.440371 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.440487 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.440754 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.441088 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.441418 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.441747 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.441888 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.442067 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.442215 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.442425 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.442522 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.442736 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.442845 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.443044 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.443128 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.443658 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.443768 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.443875 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.443965 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.444050 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.444135 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.444271 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.444440 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.444623 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.444775 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.444918 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.445059 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.445251 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.446006 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.446112 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.446365 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.446616 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.446723 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.446972 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.447082 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.447287 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.447381 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.447614 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.447715 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.447939 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.448042 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.448259 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.448361 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.448569 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.448663 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.448880 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.448975 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.449191 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.449285 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.449506 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.449826 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.450135 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.450352 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.450467 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.450576 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.450759 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.450855 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.451074 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.451182 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.451387 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.451489 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.451695 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.451808 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.452008 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.452107 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.452315 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.452409 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.452645 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.452749 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.452954 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.453059 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.453260 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.453355 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.453565 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.453677 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.453872 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.453997 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.454203 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.454318 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.454535 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.454701 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.454864 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.455022 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.455177 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.455323 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.455475 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.455628 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.455778 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.455956 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.456108 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.456309 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.456468 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.456613 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.456755 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.456897 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.457040 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.457212 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.457366 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.457510 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.457653 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.457829 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.457983 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.458182 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.458339 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.458496 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.458641 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.458795 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.458938 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.459079 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.459234 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.459382 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.459522 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.459676 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.459827 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.459983 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.460137 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.460287 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.460430 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.460571 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.460741 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.460896 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.461159 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.461300 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.461478 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.461623 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.461805 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.462022 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.462195 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.462301 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.462427 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.462521 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.462734 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.462838 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.463048 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.463146 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.463400 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.463514 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.463719 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.463819 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.465166 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.465304 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.465430 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.465547 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.465671 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.465799 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.465915 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.466028 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.466266 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.466390 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.466520 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.466644 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.466766 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.466880 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.466994 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.467107 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.467230 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.467354 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.467469 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.467583 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.467583 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.467822 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.467938 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.468052 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.468173 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.468288 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.468423 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.468524 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.468611 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.468695 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.468778 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.468862 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.468956 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.469122 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.469218 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.469304 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.469474 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.469570 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.469790 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.469894 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.470121 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.470567 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.470876 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.471303 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.471621 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.471942 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.472268 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.472582 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.472904 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.473228 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.473543 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.473866 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.474200 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.474369 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.474537 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.474874 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.475019 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.475223 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.475363 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.475521 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.475652 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.475830 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.475953 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.476136 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.476267 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.476966 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.477126 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.477283 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.477458 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.477615 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.477812 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.477934 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.478161 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.478304 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.478591 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.478712 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.478908 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.479029 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.479232 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.479363 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.479544 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.479667 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.479873 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.480013 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.480197 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.480320 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.480519 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.480653 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.480831 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.480964 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.481161 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.481282 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.481470 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.481782 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.481966 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.482103 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.482419 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.482652 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.482787 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.483031 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.483238 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.483387 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.483677 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.483820 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.483990 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.484320 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.484640 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.484975 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.485122 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.485279 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.485485 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.485629 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.485900 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.486046 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.486240 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.486457 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.486600 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.486867 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.487012 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.487167 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.487847 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.488001 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.488138 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.488279 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.488279 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.488606 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.488750 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.488750 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.489012 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.489145 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.489401 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.489536 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.489721 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.489936 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.490080 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.490423 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.490569 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.490748 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.490938 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.491075 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.491362 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.491505 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.491647 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 13:03:20.492059 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.493073 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.493506 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.493977 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.494385 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.494758 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.495665 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.495665 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.495942 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.496494 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.496885 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.497276 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.497675 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.498094 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.498580 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.498945 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.499425 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.499826 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.500231 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.500625 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.501033 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.501450 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.501885 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.502300 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.502716 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.503225 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.503627 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.504092 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.504421 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.504817 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.505214 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.505623 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.506034 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.506440 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.506861 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.507264 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.507704 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.508105 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.508503 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.508920 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.509318 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.510487 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.510487 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.510487 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.511086 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.511274 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.511692 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.512159 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.512800 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.513436 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.513885 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.514312 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.514779 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.515341 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.515553 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_db.sqlalchemy.engines [None req-7f78f419-f77e-4ec1-b9a3-f61bf511b707 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116098) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:03:20.515746 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.516098 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.516413 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:03:20.516731 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 13:03:20.540362 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_db.sqlalchemy.engines [None req-ce9bfb49-2566-4d82-b07f-6249ae0c372e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:03:20.582556 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.context [None req-7f78f419-f77e-4ec1-b9a3-f61bf511b707 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8e3cf188-1511-4f3a-b1c2-340794a1deea(cell1) {{(pid=116098) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 13:03:20.586888 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7f78f419-f77e-4ec1-b9a3-f61bf511b707 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:20.588531 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7f78f419-f77e-4ec1-b9a3-f61bf511b707 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:20.589351 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7f78f419-f77e-4ec1-b9a3-f61bf511b707 None None] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:20.591376 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7f78f419-f77e-4ec1-b9a3-f61bf511b707 None None] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:20.604675 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_db.sqlalchemy.engines [None req-7f78f419-f77e-4ec1-b9a3-f61bf511b707 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116098) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:03:20.608316 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_db.sqlalchemy.engines [None req-7f78f419-f77e-4ec1-b9a3-f61bf511b707 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116098) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:03:20.612982 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.context [None req-ce9bfb49-2566-4d82-b07f-6249ae0c372e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8e3cf188-1511-4f3a-b1c2-340794a1deea(cell1) {{(pid=116097) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 13:03:20.618036 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ce9bfb49-2566-4d82-b07f-6249ae0c372e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:20.619735 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ce9bfb49-2566-4d82-b07f-6249ae0c372e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:20.620792 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ce9bfb49-2566-4d82-b07f-6249ae0c372e None None] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:20.622583 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ce9bfb49-2566-4d82-b07f-6249ae0c372e None None] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:20.635235 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_db.sqlalchemy.engines [None req-ce9bfb49-2566-4d82-b07f-6249ae0c372e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:03:20.636935 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_db.sqlalchemy.engines [None req-ce9bfb49-2566-4d82-b07f-6249ae0c372e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:03:20.769864 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_db.sqlalchemy.engines [None req-7f78f419-f77e-4ec1-b9a3-f61bf511b707 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116098) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:03:20.801527 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_db.sqlalchemy.engines [None req-ce9bfb49-2566-4d82-b07f-6249ae0c372e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:03:21.089993 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: WARNING keystonemiddleware.auth_token [None req-7f78f419-f77e-4ec1-b9a3-f61bf511b707 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 13:03:21.096408 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: WARNING keystonemiddleware.auth_token [None req-7f78f419-f77e-4ec1-b9a3-f61bf511b707 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 13:03:21.128028 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: WARNING keystonemiddleware.auth_token [None req-ce9bfb49-2566-4d82-b07f-6249ae0c372e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 13:03:21.135226 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: WARNING keystonemiddleware.auth_token [None req-ce9bfb49-2566-4d82-b07f-6249ae0c372e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 13:03:21.437149 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: WARNING keystonemiddleware.auth_token [None req-7f78f419-f77e-4ec1-b9a3-f61bf511b707 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 13:03:21.442382 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: WARNING keystonemiddleware.auth_token [None req-7f78f419-f77e-4ec1-b9a3-f61bf511b707 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 13:03:21.447798 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56509b9669c0 pid: 116098 (default app) Dec 15 13:03:21.481697 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: WARNING keystonemiddleware.auth_token [None req-ce9bfb49-2566-4d82-b07f-6249ae0c372e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 13:03:21.486943 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: WARNING keystonemiddleware.auth_token [None req-ce9bfb49-2566-4d82-b07f-6249ae0c372e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 13:03:21.492917 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56509b9669c0 pid: 116097 (default app) Dec 15 13:03:57.043298 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7f572734-99e3-4b93-a353-6f4c50b68048 tempest-VolumesNegativeTest-2100831101 tempest-VolumesNegativeTest-2100831101-project] Action: 'create', calling method: .version_select at 0x7faf1908ae50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-728377291", "metadata": {"Type": "work"}}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:03:57.045993 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7f572734-99e3-4b93-a353-6f4c50b68048 tempest-VolumesNegativeTest-2100831101 tempest-VolumesNegativeTest-2100831101-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:03:57.050996 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7f572734-99e3-4b93-a353-6f4c50b68048 tempest-VolumesNegativeTest-2100831101 tempest-VolumesNegativeTest-2100831101-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.364960 Dec 15 13:03:57.052255 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 1/1] 10.222.0.57 () {60 vars in 1155 bytes} [Wed Dec 15 13:03:55 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1367 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:03:57.066751 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1bb496a4-7ff9-4ec1-a8db-dfe6757236ea tempest-VolumesNegativeTest-2100831101 tempest-VolumesNegativeTest-2100831101-project] Action: 'create', calling method: .version_select at 0x7faf18ffe9d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-3134842", "metadata": {"Type": "work"}}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:03:57.068599 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1bb496a4-7ff9-4ec1-a8db-dfe6757236ea tempest-VolumesNegativeTest-2100831101 tempest-VolumesNegativeTest-2100831101-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:03:57.073117 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1bb496a4-7ff9-4ec1-a8db-dfe6757236ea tempest-VolumesNegativeTest-2100831101 tempest-VolumesNegativeTest-2100831101-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013665 Dec 15 13:03:57.078222 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 2/2] 10.222.0.57 () {60 vars in 1155 bytes} [Wed Dec 15 13:03:57 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:03:57.089020 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5e26d99a-d7c3-4578-a3fe-286be9059ffe tempest-VolumesNegativeTest-2100831101 tempest-VolumesNegativeTest-2100831101-project] Action: 'create', calling method: .version_select at 0x7faf18ffe940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-349020026", "metadata": {"Type": "work"}}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:03:57.090366 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5e26d99a-d7c3-4578-a3fe-286be9059ffe tempest-VolumesNegativeTest-2100831101 tempest-VolumesNegativeTest-2100831101-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:03:57.091511 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5e26d99a-d7c3-4578-a3fe-286be9059ffe tempest-VolumesNegativeTest-2100831101 tempest-VolumesNegativeTest-2100831101-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011349 Dec 15 13:03:57.092563 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 3/3] 10.222.0.57 () {60 vars in 1155 bytes} [Wed Dec 15 13:03:57 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:03:57.102407 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e26ab3e4-7ca8-4aea-a2e5-baa95935dff7 tempest-VolumesNegativeTest-2100831101 tempest-VolumesNegativeTest-2100831101-project] Calling method '.version_select at 0x7faf18fd84c0>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:57.559879 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-2b930d9d-f7d1-4590-869a-85816989360f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-446401214", "imageRef": "67890983-693f-44ed-bdf3-22321abeab26", "flavorRef": "452", "networks": [{"uuid": "da9d8d52-8eaf-4d63-b636-b1aa4e3e7efe"}]}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:03:58.292686 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-e26ab3e4-7ca8-4aea-a2e5-baa95935dff7 tempest-VolumesNegativeTest-2100831101 tempest-VolumesNegativeTest-2100831101-project] HTTP exception thrown: Volume tempest-invalid-1115531267 could not be found. Dec 15 13:03:58.293432 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e26ab3e4-7ca8-4aea-a2e5-baa95935dff7 tempest-VolumesNegativeTest-2100831101 tempest-VolumesNegativeTest-2100831101-project] Returning 404 to user: Volume tempest-invalid-1115531267 could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:03:58.295564 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e26ab3e4-7ca8-4aea-a2e5-baa95935dff7 tempest-VolumesNegativeTest-2100831101 tempest-VolumesNegativeTest-2100831101-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1115531267" status: 404 len: 99 microversion: 2.1 time: 1.196933 Dec 15 13:03:58.296556 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 4/4] 10.222.0.57 () {58 vars in 1217 bytes} [Wed Dec 15 13:03:57 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1115531267 => generated 99 bytes in 1199 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Dec 15 13:03:58.306623 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-bbc92103-b8fb-4dae-a08d-0bf06b028803 tempest-VolumesNegativeTest-2100831101 tempest-VolumesNegativeTest-2100831101-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004307 Dec 15 13:03:58.314462 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 5/5] 10.222.0.57 () {58 vars in 1139 bytes} [Wed Dec 15 13:03:58 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 15 13:03:58.319244 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-78b04f16-242e-46a1-809e-d509a224a86d tempest-VolumesNegativeTest-2100831101 tempest-VolumesNegativeTest-2100831101-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003531 Dec 15 13:03:58.324753 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 6/6] 10.222.0.57 () {58 vars in 1136 bytes} [Wed Dec 15 13:03:58 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 15 13:03:58.335331 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7af08481-a13d-4ee6-b3b3-bcad8a9380e0 tempest-VolumesNegativeTest-2100831101 tempest-VolumesNegativeTest-2100831101-project] Calling method '.version_select at 0x7faf18f64ee0>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:58.484016 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.network.neutron [None req-2b930d9d-f7d1-4590-869a-85816989360f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] validate_networks() for [('da9d8d52-8eaf-4d63-b636-b1aa4e3e7efe', None, None, None, None, None)] {{(pid=116097) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:03:58.587467 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-7af08481-a13d-4ee6-b3b3-bcad8a9380e0 tempest-VolumesNegativeTest-2100831101 tempest-VolumesNegativeTest-2100831101-project] HTTP exception thrown: Volume cf6368b3-7a2b-4857-9b77-9d8c038f5b6c could not be found. Dec 15 13:03:58.588071 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7af08481-a13d-4ee6-b3b3-bcad8a9380e0 tempest-VolumesNegativeTest-2100831101 tempest-VolumesNegativeTest-2100831101-project] Returning 404 to user: Volume cf6368b3-7a2b-4857-9b77-9d8c038f5b6c could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:03:58.589056 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7af08481-a13d-4ee6-b3b3-bcad8a9380e0 tempest-VolumesNegativeTest-2100831101 tempest-VolumesNegativeTest-2100831101-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/cf6368b3-7a2b-4857-9b77-9d8c038f5b6c" status: 404 len: 109 microversion: 2.1 time: 0.258649 Dec 15 13:03:58.589940 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 7/7] 10.222.0.57 () {58 vars in 1247 bytes} [Wed Dec 15 13:03:58 2021] DELETE /compute/v2.1/os-volumes/cf6368b3-7a2b-4857-9b77-9d8c038f5b6c => generated 109 bytes in 260 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:03:58.672392 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e88b955d-2436-4872-8d74-44b766e9ce9b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-797176647", "imageRef": "67890983-693f-44ed-bdf3-22321abeab26", "flavorRef": "452", "networks": [{"uuid": "162c3d0f-e234-47fd-9154-3a362a7fadde"}]}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:03:58.874388 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.network.neutron [None req-e88b955d-2436-4872-8d74-44b766e9ce9b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] validate_networks() for [('162c3d0f-e234-47fd-9154-3a362a7fadde', None, None, None, None, None)] {{(pid=116098) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:04:00.758619 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-2b930d9d-f7d1-4590-869a-85816989360f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Flavor limits 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:04:00.759898 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-2b930d9d-f7d1-4590-869a-85816989360f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Image limits 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:04:00.760647 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-2b930d9d-f7d1-4590-869a-85816989360f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Flavor pref 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:04:00.761218 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-2b930d9d-f7d1-4590-869a-85816989360f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Image pref 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:04:00.761908 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-2b930d9d-f7d1-4590-869a-85816989360f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:04:00.794524 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2b930d9d-f7d1-4590-869a-85816989360f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:00.797735 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2b930d9d-f7d1-4590-869a-85816989360f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:00.799073 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2b930d9d-f7d1-4590-869a-85816989360f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:00.799519 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2b930d9d-f7d1-4590-869a-85816989360f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:00.913818 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-2b930d9d-f7d1-4590-869a-85816989360f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Getting quotas for project f0aee9b9928841cfb7feb62018fc0629. Resources: {'instances', 'cores', 'ram'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:04:00.932031 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-2b930d9d-f7d1-4590-869a-85816989360f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Getting quotas for user 9417502138f842d7aab2759e0963cab3 and project f0aee9b9928841cfb7feb62018fc0629. Resources: {'instances', 'cores', 'ram'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:04:00.963607 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-2b930d9d-f7d1-4590-869a-85816989360f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Going to run 1 instances... {{(pid=116097) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:04:00.973735 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-2b930d9d-f7d1-4590-869a-85816989360f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67890983-693f-44ed-bdf3-22321abeab26',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:04:01.203858 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-2b930d9d-f7d1-4590-869a-85816989360f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.052310 Dec 15 13:04:01.212796 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 1/8] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Dec 15 13:03:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 5057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 13:04:01.230352 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-ae29fad9-c469-4da7-9693-286223becad0 tempest-VolumesNegativeTest-2100831101 tempest-VolumesNegativeTest-2100831101-project] Calling method '.version_select at 0x7faf18685820>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:01.239408 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-e88b955d-2436-4872-8d74-44b766e9ce9b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Flavor limits 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:04:01.240506 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-e88b955d-2436-4872-8d74-44b766e9ce9b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Image limits 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:04:01.241226 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-e88b955d-2436-4872-8d74-44b766e9ce9b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Flavor pref 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:04:01.241844 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-e88b955d-2436-4872-8d74-44b766e9ce9b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Image pref 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:04:01.242500 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-e88b955d-2436-4872-8d74-44b766e9ce9b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:04:01.266601 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e88b955d-2436-4872-8d74-44b766e9ce9b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:01.267378 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e88b955d-2436-4872-8d74-44b766e9ce9b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:01.268395 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e88b955d-2436-4872-8d74-44b766e9ce9b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:01.269203 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e88b955d-2436-4872-8d74-44b766e9ce9b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:01.345352 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-e88b955d-2436-4872-8d74-44b766e9ce9b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Getting quotas for project 04e0b910ad794c7db450e6bb1c96cd01. Resources: {'instances', 'cores', 'ram'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:04:01.393522 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-e88b955d-2436-4872-8d74-44b766e9ce9b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Getting quotas for user 1b47404ef24941829d657acb729f93da and project 04e0b910ad794c7db450e6bb1c96cd01. Resources: {'instances', 'cores', 'ram'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:04:01.408301 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.wsgi [None req-ae29fad9-c469-4da7-9693-286223becad0 tempest-VolumesNegativeTest-2100831101 tempest-VolumesNegativeTest-2100831101-project] HTTP exception thrown: Volume ff5e2ae9-6b90-43bd-ae12-5858c5898b47 could not be found. Dec 15 13:04:01.410995 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-ae29fad9-c469-4da7-9693-286223becad0 tempest-VolumesNegativeTest-2100831101 tempest-VolumesNegativeTest-2100831101-project] Returning 404 to user: Volume ff5e2ae9-6b90-43bd-ae12-5858c5898b47 could not be found. {{(pid=116097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:04:01.411966 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-ae29fad9-c469-4da7-9693-286223becad0 tempest-VolumesNegativeTest-2100831101 tempest-VolumesNegativeTest-2100831101-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/ff5e2ae9-6b90-43bd-ae12-5858c5898b47" status: 404 len: 109 microversion: 2.1 time: 0.203469 Dec 15 13:04:01.417446 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e88b955d-2436-4872-8d74-44b766e9ce9b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Going to run 1 instances... {{(pid=116098) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:04:01.420921 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e88b955d-2436-4872-8d74-44b766e9ce9b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67890983-693f-44ed-bdf3-22321abeab26',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:04:01.428657 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 2/9] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Dec 15 13:04:01 2021] GET /compute/v2.1/os-volumes/ff5e2ae9-6b90-43bd-ae12-5858c5898b47 => generated 109 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:04:01.455701 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-8c5edfc4-c8b4-41bc-94fd-4cafc94c3119 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:01.462938 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-8c5edfc4-c8b4-41bc-94fd-4cafc94c3119 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:01.664996 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e88b955d-2436-4872-8d74-44b766e9ce9b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.073772 Dec 15 13:04:01.665648 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 8/10] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Dec 15 13:03:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 3075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:04:01.691422 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d4d49b21-fdee-4588-bfc6-63d2165dd534 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:01.692114 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d4d49b21-fdee-4588-bfc6-63d2165dd534 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:02.176031 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d4d49b21-fdee-4588-bfc6-63d2165dd534 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:02.211678 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d4d49b21-fdee-4588-bfc6-63d2165dd534 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 200 len: 1217 microversion: 2.1 time: 0.539039 Dec 15 13:04:02.222366 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 9/11] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:01 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 1217 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:02.277856 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-8c5edfc4-c8b4-41bc-94fd-4cafc94c3119 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9417502138f842d7aab2759e0963cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aee9b9928841cfb7feb62018fc0629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:02.311551 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-8c5edfc4-c8b4-41bc-94fd-4cafc94c3119 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 200 len: 1214 microversion: 2.1 time: 0.881710 Dec 15 13:04:02.312132 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 3/12] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:01 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 1214 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:03.232654 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4d0228b9-bbad-49bc-a04e-6a1a8da468e6 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:03.234080 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4d0228b9-bbad-49bc-a04e-6a1a8da468e6 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:03.329110 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-b6090cba-7cfc-4129-baf5-c870c026f77f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:03.330259 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-b6090cba-7cfc-4129-baf5-c870c026f77f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:03.521765 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-b6090cba-7cfc-4129-baf5-c870c026f77f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9417502138f842d7aab2759e0963cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aee9b9928841cfb7feb62018fc0629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:03.535920 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-b6090cba-7cfc-4129-baf5-c870c026f77f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 200 len: 1214 microversion: 2.1 time: 0.209555 Dec 15 13:04:03.538787 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 4/13] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:03 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 1214 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:03.630918 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4d0228b9-bbad-49bc-a04e-6a1a8da468e6 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:03.638554 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4d0228b9-bbad-49bc-a04e-6a1a8da468e6 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 200 len: 1217 microversion: 2.1 time: 0.409394 Dec 15 13:04:03.642447 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 10/14] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:03 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 1217 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:04.555271 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-217a9d1c-31b1-41ed-b8b3-5b1631f5875c tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:04.556014 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-217a9d1c-31b1-41ed-b8b3-5b1631f5875c tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:04.565422 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-217a9d1c-31b1-41ed-b8b3-5b1631f5875c tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:04.569595 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-217a9d1c-31b1-41ed-b8b3-5b1631f5875c tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:04.571899 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-217a9d1c-31b1-41ed-b8b3-5b1631f5875c tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:04.572727 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-217a9d1c-31b1-41ed-b8b3-5b1631f5875c tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:04.656645 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-fcfb2c77-bff6-451e-b784-78fe5b52a1fd tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:04.657395 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-fcfb2c77-bff6-451e-b784-78fe5b52a1fd tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:04.665477 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fcfb2c77-bff6-451e-b784-78fe5b52a1fd tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:04.665931 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fcfb2c77-bff6-451e-b784-78fe5b52a1fd tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:04.666749 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fcfb2c77-bff6-451e-b784-78fe5b52a1fd tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:04.667187 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fcfb2c77-bff6-451e-b784-78fe5b52a1fd tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:04.944182 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-217a9d1c-31b1-41ed-b8b3-5b1631f5875c tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9417502138f842d7aab2759e0963cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aee9b9928841cfb7feb62018fc0629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:04.972210 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-217a9d1c-31b1-41ed-b8b3-5b1631f5875c tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 200 len: 1266 microversion: 2.1 time: 0.421202 Dec 15 13:04:04.972796 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 5/15] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:04 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 1266 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:04.985632 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-fcfb2c77-bff6-451e-b784-78fe5b52a1fd tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:04.999164 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-fcfb2c77-bff6-451e-b784-78fe5b52a1fd tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 200 len: 1213 microversion: 2.1 time: 0.346319 Dec 15 13:04:05.010982 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 11/16] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:04 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 1213 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:05.547908 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-bae24754-0cf7-427a-a726-c0a1e328cd0c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'create', calling method: .version_select at 0x7faf1855f790>, body: {"keypair": {"name": "tempest-keypair-1758371020"}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:04:05.587511 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-bae24754-0cf7-427a-a726-c0a1e328cd0c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Getting quotas for project 9fda976fb52842e28027e89e4d6752fe. Resources: {'key_pairs'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:04:05.593631 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-bae24754-0cf7-427a-a726-c0a1e328cd0c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Getting quotas for user a1431bb04bd14db986edcf8931bc2210 and project 9fda976fb52842e28027e89e4d6752fe. Resources: {'key_pairs'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:04:05.989015 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1d5f183c-159e-4dd7-b18e-b129e8bd57dc tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:05.991115 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1d5f183c-159e-4dd7-b18e-b129e8bd57dc tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:06.009968 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1d5f183c-159e-4dd7-b18e-b129e8bd57dc tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:06.012833 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1d5f183c-159e-4dd7-b18e-b129e8bd57dc tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:06.014409 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1d5f183c-159e-4dd7-b18e-b129e8bd57dc tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:06.015057 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1d5f183c-159e-4dd7-b18e-b129e8bd57dc tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:06.229029 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1d5f183c-159e-4dd7-b18e-b129e8bd57dc tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9417502138f842d7aab2759e0963cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aee9b9928841cfb7feb62018fc0629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:06.242444 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1d5f183c-159e-4dd7-b18e-b129e8bd57dc tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 200 len: 1266 microversion: 2.1 time: 0.255820 Dec 15 13:04:06.255970 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 12/17] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:05 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:06.263204 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5275b70e-6b8c-4ca2-bddf-693c76de9d65 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:06.264535 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5275b70e-6b8c-4ca2-bddf-693c76de9d65 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:06.281872 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5275b70e-6b8c-4ca2-bddf-693c76de9d65 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:06.283378 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5275b70e-6b8c-4ca2-bddf-693c76de9d65 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:06.284356 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5275b70e-6b8c-4ca2-bddf-693c76de9d65 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:06.287115 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5275b70e-6b8c-4ca2-bddf-693c76de9d65 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:06.426425 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5275b70e-6b8c-4ca2-bddf-693c76de9d65 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:06.437146 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5275b70e-6b8c-4ca2-bddf-693c76de9d65 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 200 len: 1213 microversion: 2.1 time: 0.175884 Dec 15 13:04:06.449969 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 13/18] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:06 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 1213 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:06.553392 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-bae24754-0cf7-427a-a726-c0a1e328cd0c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Getting quotas for project 9fda976fb52842e28027e89e4d6752fe. Resources: {'key_pairs'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:04:06.567897 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-bae24754-0cf7-427a-a726-c0a1e328cd0c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Getting quotas for user a1431bb04bd14db986edcf8931bc2210 and project 9fda976fb52842e28027e89e4d6752fe. Resources: {'key_pairs'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:04:06.610008 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-bae24754-0cf7-427a-a726-c0a1e328cd0c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 1.566617 Dec 15 13:04:06.611105 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 6/19] 10.222.0.57 () {62 vars in 1198 bytes} [Wed Dec 15 13:04:05 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 1569 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 15 13:04:07.260978 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-986c50c7-8964-4f5e-9849-c00a903dc1f6 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:07.261700 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-986c50c7-8964-4f5e-9849-c00a903dc1f6 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:07.271676 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-986c50c7-8964-4f5e-9849-c00a903dc1f6 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:07.272543 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-986c50c7-8964-4f5e-9849-c00a903dc1f6 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:07.273570 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-986c50c7-8964-4f5e-9849-c00a903dc1f6 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:07.276926 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-986c50c7-8964-4f5e-9849-c00a903dc1f6 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:07.441251 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-986c50c7-8964-4f5e-9849-c00a903dc1f6 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9417502138f842d7aab2759e0963cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aee9b9928841cfb7feb62018fc0629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:07.455606 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-986c50c7-8964-4f5e-9849-c00a903dc1f6 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 200 len: 1266 microversion: 2.1 time: 0.193750 Dec 15 13:04:07.456989 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-7aa979ab-431c-4542-80b2-3c12cbced9d3 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:07.457767 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-7aa979ab-431c-4542-80b2-3c12cbced9d3 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:07.458420 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 14/20] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:07 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:07.483697 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7aa979ab-431c-4542-80b2-3c12cbced9d3 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:07.486639 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7aa979ab-431c-4542-80b2-3c12cbced9d3 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:07.489852 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7aa979ab-431c-4542-80b2-3c12cbced9d3 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:07.496048 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7aa979ab-431c-4542-80b2-3c12cbced9d3 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:07.850634 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-7aa979ab-431c-4542-80b2-3c12cbced9d3 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:07.867476 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-7aa979ab-431c-4542-80b2-3c12cbced9d3 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 200 len: 1213 microversion: 2.1 time: 0.414352 Dec 15 13:04:07.868630 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 7/21] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:07 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 1213 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:04:08.473164 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b698f173-89a5-4a6f-b7fa-5e112dd674aa tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:08.474391 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b698f173-89a5-4a6f-b7fa-5e112dd674aa tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:08.488048 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b698f173-89a5-4a6f-b7fa-5e112dd674aa tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:08.488501 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b698f173-89a5-4a6f-b7fa-5e112dd674aa tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:08.489974 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b698f173-89a5-4a6f-b7fa-5e112dd674aa tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:08.504998 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b698f173-89a5-4a6f-b7fa-5e112dd674aa tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:08.863297 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b698f173-89a5-4a6f-b7fa-5e112dd674aa tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9417502138f842d7aab2759e0963cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aee9b9928841cfb7feb62018fc0629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:08.876419 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b698f173-89a5-4a6f-b7fa-5e112dd674aa tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 200 len: 1272 microversion: 2.1 time: 0.407451 Dec 15 13:04:08.885968 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-79d6fddb-b019-494e-9cd0-643c2707f534 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:08.887184 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-79d6fddb-b019-494e-9cd0-643c2707f534 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:08.892737 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 15/22] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:08 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 1272 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:08.898312 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-79d6fddb-b019-494e-9cd0-643c2707f534 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:08.898956 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-79d6fddb-b019-494e-9cd0-643c2707f534 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:08.899934 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-79d6fddb-b019-494e-9cd0-643c2707f534 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:08.905987 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-79d6fddb-b019-494e-9cd0-643c2707f534 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:09.149155 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-79d6fddb-b019-494e-9cd0-643c2707f534 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:09.163612 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-79d6fddb-b019-494e-9cd0-643c2707f534 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 200 len: 1275 microversion: 2.1 time: 0.280399 Dec 15 13:04:09.169753 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 8/23] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:08 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 1275 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:09.909088 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e5b79a62-3b98-432f-94bb-e6e41a4eaece tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:09.914701 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e5b79a62-3b98-432f-94bb-e6e41a4eaece tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:09.928923 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e5b79a62-3b98-432f-94bb-e6e41a4eaece tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:09.931321 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e5b79a62-3b98-432f-94bb-e6e41a4eaece tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:09.935970 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e5b79a62-3b98-432f-94bb-e6e41a4eaece tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:09.938774 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e5b79a62-3b98-432f-94bb-e6e41a4eaece tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:10.131955 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e5b79a62-3b98-432f-94bb-e6e41a4eaece tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9417502138f842d7aab2759e0963cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aee9b9928841cfb7feb62018fc0629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:10.162930 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e5b79a62-3b98-432f-94bb-e6e41a4eaece tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 200 len: 1272 microversion: 2.1 time: 0.257611 Dec 15 13:04:10.166592 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 16/24] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:09 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 1272 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:10.191595 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f580a949-2aad-4236-b722-34fcb97e55ff tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:10.193297 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f580a949-2aad-4236-b722-34fcb97e55ff tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:10.206097 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f580a949-2aad-4236-b722-34fcb97e55ff tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:10.210255 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f580a949-2aad-4236-b722-34fcb97e55ff tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:10.211583 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f580a949-2aad-4236-b722-34fcb97e55ff tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:10.212578 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f580a949-2aad-4236-b722-34fcb97e55ff tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:10.561298 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f580a949-2aad-4236-b722-34fcb97e55ff tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:10.584116 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f580a949-2aad-4236-b722-34fcb97e55ff tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 200 len: 1275 microversion: 2.1 time: 0.398614 Dec 15 13:04:10.587778 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 17/25] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:10 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 1275 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:10.980019 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-f96bbb15-0fa8-4b58-9ec6-b08f587d6957 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'create', calling method: .version_select at 0x7faf18525c10>, body: {"keypair": {"name": "tempest-keypair-1853052979"}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:04:11.037184 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-f96bbb15-0fa8-4b58-9ec6-b08f587d6957 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Getting quotas for project 9d0255d615a14a41af48a7a999a42469. Resources: {'key_pairs'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:04:11.065638 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-f96bbb15-0fa8-4b58-9ec6-b08f587d6957 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Getting quotas for user ff7f1cc9a2214907871542822081375f and project 9d0255d615a14a41af48a7a999a42469. Resources: {'key_pairs'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:04:11.182111 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c8493178-7bc4-4fa6-9460-7d716741636b tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:11.182885 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c8493178-7bc4-4fa6-9460-7d716741636b tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:11.206355 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c8493178-7bc4-4fa6-9460-7d716741636b tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:11.207286 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c8493178-7bc4-4fa6-9460-7d716741636b tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:11.212722 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c8493178-7bc4-4fa6-9460-7d716741636b tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:11.213475 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c8493178-7bc4-4fa6-9460-7d716741636b tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:11.658565 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-f96bbb15-0fa8-4b58-9ec6-b08f587d6957 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Getting quotas for project 9d0255d615a14a41af48a7a999a42469. Resources: {'key_pairs'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:04:11.673433 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-f96bbb15-0fa8-4b58-9ec6-b08f587d6957 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Getting quotas for user ff7f1cc9a2214907871542822081375f and project 9d0255d615a14a41af48a7a999a42469. Resources: {'key_pairs'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:04:11.730970 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-f96bbb15-0fa8-4b58-9ec6-b08f587d6957 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.594681 Dec 15 13:04:11.732841 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 9/26] 10.222.0.57 () {60 vars in 1157 bytes} [Wed Dec 15 13:04:10 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:11.746938 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-0d0449c1-f59f-4eb7-954c-eefc2c68f63c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:11.748587 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-0d0449c1-f59f-4eb7-954c-eefc2c68f63c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:11.766745 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0d0449c1-f59f-4eb7-954c-eefc2c68f63c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:11.768919 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0d0449c1-f59f-4eb7-954c-eefc2c68f63c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:11.771596 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0d0449c1-f59f-4eb7-954c-eefc2c68f63c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:11.774622 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0d0449c1-f59f-4eb7-954c-eefc2c68f63c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:12.063214 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-0d0449c1-f59f-4eb7-954c-eefc2c68f63c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:12.090018 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-0d0449c1-f59f-4eb7-954c-eefc2c68f63c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 200 len: 1275 microversion: 2.1 time: 0.351908 Dec 15 13:04:12.104152 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 10/27] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:11 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 1275 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:12.245174 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c8493178-7bc4-4fa6-9460-7d716741636b tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9417502138f842d7aab2759e0963cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aee9b9928841cfb7feb62018fc0629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:12.257479 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c8493178-7bc4-4fa6-9460-7d716741636b tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 200 len: 1314 microversion: 2.1 time: 1.078388 Dec 15 13:04:12.259357 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 18/28] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:11 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 1314 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:13.122576 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-010346e3-bd27-4514-9451-87cb31970300 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:13.124512 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-010346e3-bd27-4514-9451-87cb31970300 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:13.141395 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-010346e3-bd27-4514-9451-87cb31970300 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:13.144605 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-010346e3-bd27-4514-9451-87cb31970300 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:13.147994 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-010346e3-bd27-4514-9451-87cb31970300 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:13.148472 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-010346e3-bd27-4514-9451-87cb31970300 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:13.275863 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a90d01af-9b55-47b7-87e4-313746165638 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:13.276605 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a90d01af-9b55-47b7-87e4-313746165638 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:13.289504 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a90d01af-9b55-47b7-87e4-313746165638 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:13.292024 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a90d01af-9b55-47b7-87e4-313746165638 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:13.298978 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a90d01af-9b55-47b7-87e4-313746165638 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:13.300258 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a90d01af-9b55-47b7-87e4-313746165638 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:14.184739 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-010346e3-bd27-4514-9451-87cb31970300 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:14.198289 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-010346e3-bd27-4514-9451-87cb31970300 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 200 len: 1317 microversion: 2.1 time: 1.081295 Dec 15 13:04:14.209059 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 11/29] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:13 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 1317 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:14.610298 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a90d01af-9b55-47b7-87e4-313746165638 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9417502138f842d7aab2759e0963cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aee9b9928841cfb7feb62018fc0629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:14.645680 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a90d01af-9b55-47b7-87e4-313746165638 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 200 len: 1314 microversion: 2.1 time: 1.371598 Dec 15 13:04:14.650557 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 19/30] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:13 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 1314 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:04:15.124953 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-7f61ada5-20c2-4d85-a58a-7dd4589b1418 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-214402223", "imageRef": "67890983-693f-44ed-bdf3-22321abeab26", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d413ab2c-3588-4515-a60e-6c78b767a71d"}], "security_groups": [{"name": "tempest-securitygroup--141776715"}], "key_name": "tempest-keypair-1758371020", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:04:15.221244 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1c7be58f-3ab4-43e0-9608-190de8585559 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:15.222133 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1c7be58f-3ab4-43e0-9608-190de8585559 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:15.248461 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1c7be58f-3ab4-43e0-9608-190de8585559 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:15.250563 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1c7be58f-3ab4-43e0-9608-190de8585559 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:15.250563 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1c7be58f-3ab4-43e0-9608-190de8585559 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:15.250563 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1c7be58f-3ab4-43e0-9608-190de8585559 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:15.802108 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1c7be58f-3ab4-43e0-9608-190de8585559 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:15.813079 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1c7be58f-3ab4-43e0-9608-190de8585559 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 200 len: 1317 microversion: 2.1 time: 0.600239 Dec 15 13:04:15.844009 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 20/31] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:15 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 1317 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:15.850896 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-17cddb42-ae9e-4922-b3df-1fd37d266092 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:15.851755 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-17cddb42-ae9e-4922-b3df-1fd37d266092 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:15.858266 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-17cddb42-ae9e-4922-b3df-1fd37d266092 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:15.862751 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-17cddb42-ae9e-4922-b3df-1fd37d266092 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:15.863938 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-17cddb42-ae9e-4922-b3df-1fd37d266092 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:15.865546 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-17cddb42-ae9e-4922-b3df-1fd37d266092 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:15.931387 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.network.neutron [None req-7f61ada5-20c2-4d85-a58a-7dd4589b1418 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] validate_networks() for [('d413ab2c-3588-4515-a60e-6c78b767a71d', None, None, None, None, None)] {{(pid=116097) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:04:16.824922 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-17cddb42-ae9e-4922-b3df-1fd37d266092 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9417502138f842d7aab2759e0963cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aee9b9928841cfb7feb62018fc0629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:16.833095 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-17cddb42-ae9e-4922-b3df-1fd37d266092 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 200 len: 1314 microversion: 2.1 time: 0.986737 Dec 15 13:04:16.833611 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 21/32] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:15 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 1314 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:17.311522 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-7f61ada5-20c2-4d85-a58a-7dd4589b1418 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Flavor limits 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:04:17.313193 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-7f61ada5-20c2-4d85-a58a-7dd4589b1418 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Image limits 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:04:17.322423 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-7f61ada5-20c2-4d85-a58a-7dd4589b1418 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Flavor pref 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:04:17.325014 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-7f61ada5-20c2-4d85-a58a-7dd4589b1418 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Image pref 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:04:17.325469 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-7f61ada5-20c2-4d85-a58a-7dd4589b1418 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:04:17.346001 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7f61ada5-20c2-4d85-a58a-7dd4589b1418 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:17.349244 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7f61ada5-20c2-4d85-a58a-7dd4589b1418 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:17.353176 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7f61ada5-20c2-4d85-a58a-7dd4589b1418 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:17.354270 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7f61ada5-20c2-4d85-a58a-7dd4589b1418 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:17.402853 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-7f61ada5-20c2-4d85-a58a-7dd4589b1418 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Getting quotas for project 9fda976fb52842e28027e89e4d6752fe. Resources: {'instances', 'cores', 'ram'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:04:17.423960 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-7f61ada5-20c2-4d85-a58a-7dd4589b1418 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Getting quotas for user a1431bb04bd14db986edcf8931bc2210 and project 9fda976fb52842e28027e89e4d6752fe. Resources: {'instances', 'cores', 'ram'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:04:17.442323 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-7f61ada5-20c2-4d85-a58a-7dd4589b1418 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Going to run 1 instances... {{(pid=116097) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:04:17.445213 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-7f61ada5-20c2-4d85-a58a-7dd4589b1418 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67890983-693f-44ed-bdf3-22321abeab26',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:04:17.532858 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-79352274-bfc7-467b-862f-1d1a86fe86c7 req-89ad4ae8-3d27-421d-98cd-c931e8f3a184 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8306f62d-ed9e-459a-b0e8-3d5c2fbffd36", "tag": "e7607ece-d8d6-4ca2-bec8-01ff0516ff27"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:04:17.538242 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-7f61ada5-20c2-4d85-a58a-7dd4589b1418 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.418333 Dec 15 13:04:17.539416 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 12/33] 10.222.0.57 () {62 vars in 1187 bytes} [Wed Dec 15 13:04:15 2021] POST /compute/v2.1/servers => generated 401 bytes in 2421 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 15 13:04:17.545524 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:04:17.545524 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:04:17.547954 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-2a3054d6-222e-49c8-8c9e-66b0e0affa26 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:17.549468 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-2a3054d6-222e-49c8-8c9e-66b0e0affa26 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:17.559528 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2a3054d6-222e-49c8-8c9e-66b0e0affa26 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:17.560611 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2a3054d6-222e-49c8-8c9e-66b0e0affa26 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:17.563249 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2a3054d6-222e-49c8-8c9e-66b0e0affa26 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:17.564524 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2a3054d6-222e-49c8-8c9e-66b0e0affa26 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:17.587667 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-79352274-bfc7-467b-862f-1d1a86fe86c7 req-89ad4ae8-3d27-421d-98cd-c931e8f3a184 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:17.595012 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-79352274-bfc7-467b-862f-1d1a86fe86c7 req-89ad4ae8-3d27-421d-98cd-c931e8f3a184 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:17.661440 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-79352274-bfc7-467b-862f-1d1a86fe86c7 req-89ad4ae8-3d27-421d-98cd-c931e8f3a184 service nova] Creating event network-changed:e7607ece-d8d6-4ca2-bec8-01ff0516ff27 for instance 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 on hv-cinder-81322 Dec 15 13:04:17.666584 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-79352274-bfc7-467b-862f-1d1a86fe86c7 req-89ad4ae8-3d27-421d-98cd-c931e8f3a184 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116098) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 15 13:04:17.668046 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ee253763-b89c-4812-b1ab-30b1fff64e4d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:17.670992 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ee253763-b89c-4812-b1ab-30b1fff64e4d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:17.675077 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ee253763-b89c-4812-b1ab-30b1fff64e4d None None] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:17.675668 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ee253763-b89c-4812-b1ab-30b1fff64e4d None None] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:17.706507 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.compute.rpcapi [None req-ee253763-b89c-4812-b1ab-30b1fff64e4d None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 15 13:04:17.707981 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ee253763-b89c-4812-b1ab-30b1fff64e4d None None] Releasing lock "compute-rpcapi-router" {{(pid=116098) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 15 13:04:17.795218 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ee253763-b89c-4812-b1ab-30b1fff64e4d None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.950910 Dec 15 13:04:17.796505 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 22/34] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:04:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:04:17.818567 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-55389f2c-fa60-4121-81f0-78c772f820f7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:17.823852 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-55389f2c-fa60-4121-81f0-78c772f820f7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:18.084632 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-55389f2c-fa60-4121-81f0-78c772f820f7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:18.096275 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-55389f2c-fa60-4121-81f0-78c772f820f7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:18.105812 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-55389f2c-fa60-4121-81f0-78c772f820f7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:18.116235 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-55389f2c-fa60-4121-81f0-78c772f820f7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1281 microversion: 2.20 time: 0.316762 Dec 15 13:04:18.117277 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 23/35] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:04:17 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1281 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:04:18.136695 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ccadf9ae-7be1-4f70-a2c5-1c9907503909 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:18.137944 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ccadf9ae-7be1-4f70-a2c5-1c9907503909 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:18.160103 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ccadf9ae-7be1-4f70-a2c5-1c9907503909 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:18.163457 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ccadf9ae-7be1-4f70-a2c5-1c9907503909 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:18.165826 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ccadf9ae-7be1-4f70-a2c5-1c9907503909 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:18.169343 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ccadf9ae-7be1-4f70-a2c5-1c9907503909 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:18.217971 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-2a3054d6-222e-49c8-8c9e-66b0e0affa26 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:18.227459 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-2a3054d6-222e-49c8-8c9e-66b0e0affa26 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 200 len: 1317 microversion: 2.1 time: 0.686831 Dec 15 13:04:18.230411 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 13/36] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:17 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 1317 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:19.306362 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-03cd1efe-b3d6-4248-a33c-2fa9a515aebd req-0db50c68-e40e-4b87-a5a3-a641f0818e60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff", "tag": "5b7da152-6ada-44e9-b82c-2cd8bd9b0213"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:04:19.309771 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:04:19.309771 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:04:19.340452 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-03cd1efe-b3d6-4248-a33c-2fa9a515aebd req-0db50c68-e40e-4b87-a5a3-a641f0818e60 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:19.340911 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-03cd1efe-b3d6-4248-a33c-2fa9a515aebd req-0db50c68-e40e-4b87-a5a3-a641f0818e60 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:19.399734 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-03cd1efe-b3d6-4248-a33c-2fa9a515aebd req-0db50c68-e40e-4b87-a5a3-a641f0818e60 service nova] Creating event network-changed:5b7da152-6ada-44e9-b82c-2cd8bd9b0213 for instance fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff on hv-cinder-81322 Dec 15 13:04:19.400296 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-03cd1efe-b3d6-4248-a33c-2fa9a515aebd req-0db50c68-e40e-4b87-a5a3-a641f0818e60 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116097) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 15 13:04:19.405634 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d1bc58a1-d921-4044-9fcd-d5ab29404e38 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:19.406177 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d1bc58a1-d921-4044-9fcd-d5ab29404e38 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:19.407398 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d1bc58a1-d921-4044-9fcd-d5ab29404e38 None None] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:19.408421 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d1bc58a1-d921-4044-9fcd-d5ab29404e38 None None] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:19.438748 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.compute.rpcapi [None req-d1bc58a1-d921-4044-9fcd-d5ab29404e38 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 15 13:04:19.443379 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d1bc58a1-d921-4044-9fcd-d5ab29404e38 None None] Releasing lock "compute-rpcapi-router" {{(pid=116097) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 15 13:04:19.516628 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-d1bc58a1-d921-4044-9fcd-d5ab29404e38 None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.604385 Dec 15 13:04:19.517805 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 14/37] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:04:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:04:19.525267 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-36c5fd0e-52be-4c06-ab3a-57c614850d6e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:19.528745 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-36c5fd0e-52be-4c06-ab3a-57c614850d6e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:19.540157 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-36c5fd0e-52be-4c06-ab3a-57c614850d6e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:19.542755 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-36c5fd0e-52be-4c06-ab3a-57c614850d6e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:19.544203 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-36c5fd0e-52be-4c06-ab3a-57c614850d6e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:19.546557 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-36c5fd0e-52be-4c06-ab3a-57c614850d6e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:19.579645 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ccadf9ae-7be1-4f70-a2c5-1c9907503909 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9417502138f842d7aab2759e0963cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aee9b9928841cfb7feb62018fc0629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:19.587997 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ccadf9ae-7be1-4f70-a2c5-1c9907503909 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 200 len: 1314 microversion: 2.1 time: 1.468699 Dec 15 13:04:19.603318 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 24/38] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:18 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 1314 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:19.612171 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-696dd207-6afe-46f5-99d3-7005e9d3c3fe tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:19.612913 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-696dd207-6afe-46f5-99d3-7005e9d3c3fe tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:19.633456 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-696dd207-6afe-46f5-99d3-7005e9d3c3fe tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:19.633915 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-696dd207-6afe-46f5-99d3-7005e9d3c3fe tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:19.634777 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-696dd207-6afe-46f5-99d3-7005e9d3c3fe tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:19.635215 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-696dd207-6afe-46f5-99d3-7005e9d3c3fe tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:19.912013 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-36c5fd0e-52be-4c06-ab3a-57c614850d6e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:19.925276 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-36c5fd0e-52be-4c06-ab3a-57c614850d6e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:19.930926 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-36c5fd0e-52be-4c06-ab3a-57c614850d6e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:19.934586 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-36c5fd0e-52be-4c06-ab3a-57c614850d6e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1285 microversion: 2.20 time: 0.413316 Dec 15 13:04:19.935773 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 15/39] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:04:19 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1285 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:04:20.172964 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-696dd207-6afe-46f5-99d3-7005e9d3c3fe tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:20.184989 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-696dd207-6afe-46f5-99d3-7005e9d3c3fe tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 200 len: 1317 microversion: 2.1 time: 0.580230 Dec 15 13:04:20.195986 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 25/40] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:19 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 1317 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:20.218518 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-afee593e-f22e-41e1-acc8-abd19b69663a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-184077892", "imageRef": "67890983-693f-44ed-bdf3-22321abeab26", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "215eb43b-ffe8-4825-a527-195837dc5851"}], "security_groups": [{"name": "tempest-securitygroup--1216958687"}], "key_name": "tempest-keypair-1853052979", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:04:20.370719 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.network.neutron [None req-afee593e-f22e-41e1-acc8-abd19b69663a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] validate_networks() for [('215eb43b-ffe8-4825-a527-195837dc5851', None, None, None, None, None)] {{(pid=116097) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:04:20.607484 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c18e2078-7e46-4e9d-8411-0f9783d317a2 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:20.608853 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c18e2078-7e46-4e9d-8411-0f9783d317a2 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:20.615100 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c18e2078-7e46-4e9d-8411-0f9783d317a2 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:20.615742 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c18e2078-7e46-4e9d-8411-0f9783d317a2 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:20.616676 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c18e2078-7e46-4e9d-8411-0f9783d317a2 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:20.617249 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c18e2078-7e46-4e9d-8411-0f9783d317a2 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:20.802307 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c18e2078-7e46-4e9d-8411-0f9783d317a2 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9417502138f842d7aab2759e0963cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aee9b9928841cfb7feb62018fc0629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:20.846884 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c18e2078-7e46-4e9d-8411-0f9783d317a2 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 200 len: 1314 microversion: 2.1 time: 0.243098 Dec 15 13:04:20.847830 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 26/41] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:20 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:20.954566 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-37b40b0f-6bbb-4b93-94e0-a7acabcb78e8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:20.956546 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-37b40b0f-6bbb-4b93-94e0-a7acabcb78e8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:20.967063 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-37b40b0f-6bbb-4b93-94e0-a7acabcb78e8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:20.969096 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-37b40b0f-6bbb-4b93-94e0-a7acabcb78e8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:20.971975 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-37b40b0f-6bbb-4b93-94e0-a7acabcb78e8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:20.972641 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-37b40b0f-6bbb-4b93-94e0-a7acabcb78e8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:21.013605 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-afee593e-f22e-41e1-acc8-abd19b69663a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Flavor limits 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:04:21.013956 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-afee593e-f22e-41e1-acc8-abd19b69663a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Image limits 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:04:21.014506 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-afee593e-f22e-41e1-acc8-abd19b69663a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Flavor pref 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:04:21.014935 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-afee593e-f22e-41e1-acc8-abd19b69663a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Image pref 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:04:21.015368 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-afee593e-f22e-41e1-acc8-abd19b69663a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:04:21.029757 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-afee593e-f22e-41e1-acc8-abd19b69663a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:21.030296 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-afee593e-f22e-41e1-acc8-abd19b69663a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:21.031188 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-afee593e-f22e-41e1-acc8-abd19b69663a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:21.031626 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-afee593e-f22e-41e1-acc8-abd19b69663a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:21.060319 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-afee593e-f22e-41e1-acc8-abd19b69663a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Getting quotas for project 9d0255d615a14a41af48a7a999a42469. Resources: {'instances', 'cores', 'ram'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:04:21.065404 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-afee593e-f22e-41e1-acc8-abd19b69663a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Getting quotas for user ff7f1cc9a2214907871542822081375f and project 9d0255d615a14a41af48a7a999a42469. Resources: {'instances', 'cores', 'ram'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:04:21.081426 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-37b40b0f-6bbb-4b93-94e0-a7acabcb78e8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:21.102056 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-37b40b0f-6bbb-4b93-94e0-a7acabcb78e8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:21.107344 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-37b40b0f-6bbb-4b93-94e0-a7acabcb78e8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:21.111182 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-37b40b0f-6bbb-4b93-94e0-a7acabcb78e8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1277 microversion: 2.20 time: 0.161033 Dec 15 13:04:21.121094 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 27/42] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:04:20 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:04:21.126716 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-afee593e-f22e-41e1-acc8-abd19b69663a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Going to run 1 instances... {{(pid=116097) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:04:21.129438 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-afee593e-f22e-41e1-acc8-abd19b69663a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67890983-693f-44ed-bdf3-22321abeab26',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:04:21.194319 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-afee593e-f22e-41e1-acc8-abd19b69663a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.980197 Dec 15 13:04:21.195491 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 16/43] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Dec 15 13:04:20 2021] POST /compute/v2.1/servers => generated 402 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:04:21.210351 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b79deb93-523d-4be3-a963-6f87fd967c98 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:21.213703 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b79deb93-523d-4be3-a963-6f87fd967c98 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:21.228257 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b79deb93-523d-4be3-a963-6f87fd967c98 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:21.231512 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b79deb93-523d-4be3-a963-6f87fd967c98 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:21.236868 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-8efe8e83-a2e4-4829-bd01-e8ac93b57326 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:21.238354 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b79deb93-523d-4be3-a963-6f87fd967c98 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:21.239025 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b79deb93-523d-4be3-a963-6f87fd967c98 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:21.239680 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-8efe8e83-a2e4-4829-bd01-e8ac93b57326 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:21.328888 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-8efe8e83-a2e4-4829-bd01-e8ac93b57326 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:21.336321 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-8efe8e83-a2e4-4829-bd01-e8ac93b57326 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1237 microversion: 2.1 time: 0.113431 Dec 15 13:04:21.336898 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 17/44] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:21 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1237 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:21.492143 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b79deb93-523d-4be3-a963-6f87fd967c98 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:21.506595 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b79deb93-523d-4be3-a963-6f87fd967c98 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 200 len: 1317 microversion: 2.1 time: 0.305493 Dec 15 13:04:21.508387 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 28/45] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:21 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 1317 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:04:21.870230 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-7e3c4589-ea9d-428a-8340-ff6f476e2a58 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:21.872347 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-7e3c4589-ea9d-428a-8340-ff6f476e2a58 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:21.896287 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7e3c4589-ea9d-428a-8340-ff6f476e2a58 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:21.897184 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7e3c4589-ea9d-428a-8340-ff6f476e2a58 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:21.901317 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7e3c4589-ea9d-428a-8340-ff6f476e2a58 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:21.902159 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7e3c4589-ea9d-428a-8340-ff6f476e2a58 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:22.132744 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a592899f-7f40-4eea-9078-3dc12594d7ad tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:22.134035 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a592899f-7f40-4eea-9078-3dc12594d7ad tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:22.145339 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a592899f-7f40-4eea-9078-3dc12594d7ad tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:22.147733 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a592899f-7f40-4eea-9078-3dc12594d7ad tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:22.148511 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a592899f-7f40-4eea-9078-3dc12594d7ad tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:22.148962 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a592899f-7f40-4eea-9078-3dc12594d7ad tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:22.175374 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-7e3c4589-ea9d-428a-8340-ff6f476e2a58 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9417502138f842d7aab2759e0963cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aee9b9928841cfb7feb62018fc0629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:22.184745 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-7e3c4589-ea9d-428a-8340-ff6f476e2a58 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 200 len: 1314 microversion: 2.1 time: 0.323609 Dec 15 13:04:22.198305 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 18/46] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:21 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:22.240569 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a592899f-7f40-4eea-9078-3dc12594d7ad tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:22.249265 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a592899f-7f40-4eea-9078-3dc12594d7ad tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:22.250808 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a592899f-7f40-4eea-9078-3dc12594d7ad tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:22.252103 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a592899f-7f40-4eea-9078-3dc12594d7ad tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1277 microversion: 2.20 time: 0.125656 Dec 15 13:04:22.263097 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 29/47] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:04:22 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1277 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:04:22.355748 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-cc296b12-4fd8-43f7-a0db-b8d262fa6d0e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:22.356484 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-cc296b12-4fd8-43f7-a0db-b8d262fa6d0e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:22.363288 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cc296b12-4fd8-43f7-a0db-b8d262fa6d0e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:22.363750 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cc296b12-4fd8-43f7-a0db-b8d262fa6d0e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:22.364543 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cc296b12-4fd8-43f7-a0db-b8d262fa6d0e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:22.364991 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cc296b12-4fd8-43f7-a0db-b8d262fa6d0e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:22.438201 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-cc296b12-4fd8-43f7-a0db-b8d262fa6d0e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:22.447253 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-cc296b12-4fd8-43f7-a0db-b8d262fa6d0e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1241 microversion: 2.1 time: 0.095657 Dec 15 13:04:22.457913 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 19/48] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:22 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1241 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:22.525958 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a026639f-70b4-44e4-af4f-0af9ac733cdd tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:22.527687 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a026639f-70b4-44e4-af4f-0af9ac733cdd tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:22.533684 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a026639f-70b4-44e4-af4f-0af9ac733cdd tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:22.534389 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a026639f-70b4-44e4-af4f-0af9ac733cdd tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:22.535368 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a026639f-70b4-44e4-af4f-0af9ac733cdd tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:22.535809 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a026639f-70b4-44e4-af4f-0af9ac733cdd tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:22.715512 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a026639f-70b4-44e4-af4f-0af9ac733cdd tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:22.723482 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a026639f-70b4-44e4-af4f-0af9ac733cdd tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 200 len: 1317 microversion: 2.1 time: 0.200879 Dec 15 13:04:22.732864 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 30/49] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:22 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:23.207742 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-6f5ae0bd-3f20-4474-ada9-2cb640756005 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:23.208449 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-6f5ae0bd-3f20-4474-ada9-2cb640756005 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:23.215832 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6f5ae0bd-3f20-4474-ada9-2cb640756005 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:23.216884 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6f5ae0bd-3f20-4474-ada9-2cb640756005 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:23.217897 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6f5ae0bd-3f20-4474-ada9-2cb640756005 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:23.218834 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6f5ae0bd-3f20-4474-ada9-2cb640756005 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:23.271759 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d60298b5-143a-4c26-91e8-5b719428e18d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:23.272821 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d60298b5-143a-4c26-91e8-5b719428e18d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:23.279632 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d60298b5-143a-4c26-91e8-5b719428e18d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:23.291953 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d60298b5-143a-4c26-91e8-5b719428e18d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:23.293803 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d60298b5-143a-4c26-91e8-5b719428e18d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:23.296745 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d60298b5-143a-4c26-91e8-5b719428e18d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:23.438882 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d60298b5-143a-4c26-91e8-5b719428e18d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:23.453914 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d60298b5-143a-4c26-91e8-5b719428e18d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:23.455592 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d60298b5-143a-4c26-91e8-5b719428e18d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:23.456740 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d60298b5-143a-4c26-91e8-5b719428e18d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1277 microversion: 2.20 time: 0.189816 Dec 15 13:04:23.457868 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 31/50] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:04:23 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1277 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:04:23.490785 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-08251fe4-25f4-465e-b587-427475dcde9b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:23.491439 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-08251fe4-25f4-465e-b587-427475dcde9b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:23.513444 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-08251fe4-25f4-465e-b587-427475dcde9b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:23.517501 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-08251fe4-25f4-465e-b587-427475dcde9b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:23.518698 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-08251fe4-25f4-465e-b587-427475dcde9b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:23.526582 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-08251fe4-25f4-465e-b587-427475dcde9b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:23.611237 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-6f5ae0bd-3f20-4474-ada9-2cb640756005 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9417502138f842d7aab2759e0963cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aee9b9928841cfb7feb62018fc0629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:23.620018 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-6f5ae0bd-3f20-4474-ada9-2cb640756005 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 200 len: 1314 microversion: 2.1 time: 0.416627 Dec 15 13:04:23.620589 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 20/51] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:23 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:23.689168 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-08251fe4-25f4-465e-b587-427475dcde9b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:23.697423 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-08251fe4-25f4-465e-b587-427475dcde9b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1241 microversion: 2.1 time: 0.229788 Dec 15 13:04:23.698631 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 32/52] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:23 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1241 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:23.740216 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-082f95c0-1b97-4498-88a9-2c1329ddd82c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:23.740846 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-082f95c0-1b97-4498-88a9-2c1329ddd82c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:23.748783 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-082f95c0-1b97-4498-88a9-2c1329ddd82c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:23.749248 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-082f95c0-1b97-4498-88a9-2c1329ddd82c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:23.750052 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-082f95c0-1b97-4498-88a9-2c1329ddd82c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:23.754472 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-082f95c0-1b97-4498-88a9-2c1329ddd82c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:24.136404 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-082f95c0-1b97-4498-88a9-2c1329ddd82c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:24.145873 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-082f95c0-1b97-4498-88a9-2c1329ddd82c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 200 len: 1317 microversion: 2.1 time: 0.408683 Dec 15 13:04:24.147658 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 21/53] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:23 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 1317 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:24.478049 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-370d2ccc-21e5-4398-9722-f366b1b08ccc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:24.478703 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-370d2ccc-21e5-4398-9722-f366b1b08ccc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:24.487408 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-370d2ccc-21e5-4398-9722-f366b1b08ccc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:24.487870 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-370d2ccc-21e5-4398-9722-f366b1b08ccc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:24.488706 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-370d2ccc-21e5-4398-9722-f366b1b08ccc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:24.489143 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-370d2ccc-21e5-4398-9722-f366b1b08ccc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:24.639104 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-f13baece-98ed-4821-b1b7-eefff929c3cf tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:24.640161 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-f13baece-98ed-4821-b1b7-eefff929c3cf tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:24.667717 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f13baece-98ed-4821-b1b7-eefff929c3cf tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:24.668995 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f13baece-98ed-4821-b1b7-eefff929c3cf tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:24.671292 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f13baece-98ed-4821-b1b7-eefff929c3cf tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:24.673410 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f13baece-98ed-4821-b1b7-eefff929c3cf tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:24.689069 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-370d2ccc-21e5-4398-9722-f366b1b08ccc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:24.703454 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-370d2ccc-21e5-4398-9722-f366b1b08ccc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:24.718514 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-370d2ccc-21e5-4398-9722-f366b1b08ccc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:24.720061 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-370d2ccc-21e5-4398-9722-f366b1b08ccc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1351 microversion: 2.20 time: 0.245584 Dec 15 13:04:24.732543 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 33/54] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:04:24 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1351 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:04:24.734802 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6eeea1ae-b2a9-4ce0-9320-e3894876cd42 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:24.735157 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-6eeea1ae-b2a9-4ce0-9320-e3894876cd42 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:24.766139 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6eeea1ae-b2a9-4ce0-9320-e3894876cd42 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:24.771408 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6eeea1ae-b2a9-4ce0-9320-e3894876cd42 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:24.772772 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6eeea1ae-b2a9-4ce0-9320-e3894876cd42 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:24.773491 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6eeea1ae-b2a9-4ce0-9320-e3894876cd42 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:24.999336 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-6eeea1ae-b2a9-4ce0-9320-e3894876cd42 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:25.010280 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6eeea1ae-b2a9-4ce0-9320-e3894876cd42 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1307 microversion: 2.1 time: 0.279347 Dec 15 13:04:25.011418 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 34/55] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:24 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1307 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:25.087090 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-f13baece-98ed-4821-b1b7-eefff929c3cf tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9417502138f842d7aab2759e0963cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aee9b9928841cfb7feb62018fc0629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:25.094622 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-f13baece-98ed-4821-b1b7-eefff929c3cf tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 200 len: 1314 microversion: 2.1 time: 0.461073 Dec 15 13:04:25.095209 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 22/56] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:24 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:04:25.171744 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1ed31912-ebf9-4a80-8cfc-aaf7414abff9 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:25.173751 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1ed31912-ebf9-4a80-8cfc-aaf7414abff9 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:25.185477 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1ed31912-ebf9-4a80-8cfc-aaf7414abff9 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:25.197159 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1ed31912-ebf9-4a80-8cfc-aaf7414abff9 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:25.198187 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1ed31912-ebf9-4a80-8cfc-aaf7414abff9 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:25.198768 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1ed31912-ebf9-4a80-8cfc-aaf7414abff9 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:25.459022 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1ed31912-ebf9-4a80-8cfc-aaf7414abff9 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:25.472054 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1ed31912-ebf9-4a80-8cfc-aaf7414abff9 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 200 len: 1317 microversion: 2.1 time: 0.312361 Dec 15 13:04:25.473590 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 35/57] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:25 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:25.746448 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-516ab351-1b09-46a4-b90e-6087bae58b0c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:25.747176 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-516ab351-1b09-46a4-b90e-6087bae58b0c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:25.760978 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-516ab351-1b09-46a4-b90e-6087bae58b0c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:25.765203 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-516ab351-1b09-46a4-b90e-6087bae58b0c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:25.767748 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-516ab351-1b09-46a4-b90e-6087bae58b0c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:25.769080 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-516ab351-1b09-46a4-b90e-6087bae58b0c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:26.030064 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-439f36fc-3376-47e5-a444-67f2ef4dfc01 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:26.030534 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-439f36fc-3376-47e5-a444-67f2ef4dfc01 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:26.041188 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-439f36fc-3376-47e5-a444-67f2ef4dfc01 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:26.043093 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-439f36fc-3376-47e5-a444-67f2ef4dfc01 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:26.046227 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-439f36fc-3376-47e5-a444-67f2ef4dfc01 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:26.047248 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-439f36fc-3376-47e5-a444-67f2ef4dfc01 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:26.162477 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-516ab351-1b09-46a4-b90e-6087bae58b0c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:26.181150 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-516ab351-1b09-46a4-b90e-6087bae58b0c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:26.182707 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-516ab351-1b09-46a4-b90e-6087bae58b0c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:26.183834 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-516ab351-1b09-46a4-b90e-6087bae58b0c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1406 microversion: 2.20 time: 0.449615 Dec 15 13:04:26.184700 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 23/58] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:04:25 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1406 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:04:26.196888 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-da8af00f-6da0-4476-8142-22e5fa34b0f5 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:26.197780 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-da8af00f-6da0-4476-8142-22e5fa34b0f5 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:26.217339 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-da8af00f-6da0-4476-8142-22e5fa34b0f5 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:26.230731 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-da8af00f-6da0-4476-8142-22e5fa34b0f5 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:26.232927 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-da8af00f-6da0-4476-8142-22e5fa34b0f5 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:26.263365 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-da8af00f-6da0-4476-8142-22e5fa34b0f5 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:26.456447 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-439f36fc-3376-47e5-a444-67f2ef4dfc01 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:26.464482 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-439f36fc-3376-47e5-a444-67f2ef4dfc01 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1363 microversion: 2.1 time: 0.440884 Dec 15 13:04:26.467176 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 36/59] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:26 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1363 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:04:26.489006 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8c686b58-a670-428f-b239-3c9eb0b91701 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:26.489979 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8c686b58-a670-428f-b239-3c9eb0b91701 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:26.497289 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8c686b58-a670-428f-b239-3c9eb0b91701 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:26.501652 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8c686b58-a670-428f-b239-3c9eb0b91701 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:26.502724 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8c686b58-a670-428f-b239-3c9eb0b91701 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:26.504042 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8c686b58-a670-428f-b239-3c9eb0b91701 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:26.531539 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-da8af00f-6da0-4476-8142-22e5fa34b0f5 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9417502138f842d7aab2759e0963cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aee9b9928841cfb7feb62018fc0629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:26.544885 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-da8af00f-6da0-4476-8142-22e5fa34b0f5 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 200 len: 1314 microversion: 2.1 time: 0.358984 Dec 15 13:04:26.546055 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 24/60] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:26 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:26.843756 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8c686b58-a670-428f-b239-3c9eb0b91701 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:26.854400 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8c686b58-a670-428f-b239-3c9eb0b91701 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 200 len: 1317 microversion: 2.1 time: 0.369061 Dec 15 13:04:26.863216 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 37/61] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:26 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:04:27.153652 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-476a9d58-96c9-4493-898d-9ed73ab54848 req-eba7ff96-2b12-4339-8a2b-1823582bdab6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "703b5e88-39f0-436c-ac5a-f1701ec4d7c9", "tag": "82fec70a-827b-4ef1-8922-a834a47147e1"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:04:27.155572 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:04:27.155572 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:04:27.177402 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-476a9d58-96c9-4493-898d-9ed73ab54848 req-eba7ff96-2b12-4339-8a2b-1823582bdab6 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:27.177867 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-476a9d58-96c9-4493-898d-9ed73ab54848 req-eba7ff96-2b12-4339-8a2b-1823582bdab6 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:27.194396 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-476a9d58-96c9-4493-898d-9ed73ab54848 req-eba7ff96-2b12-4339-8a2b-1823582bdab6 service nova] Creating event network-changed:82fec70a-827b-4ef1-8922-a834a47147e1 for instance 703b5e88-39f0-436c-ac5a-f1701ec4d7c9 on hv-cinder-81322 Dec 15 13:04:27.199476 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-476a9d58-96c9-4493-898d-9ed73ab54848 req-eba7ff96-2b12-4339-8a2b-1823582bdab6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049289 Dec 15 13:04:27.200312 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 25/62] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:04:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:04:27.206308 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-64ac2894-1ecb-4b8b-8510-e96a27ab89b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:27.207622 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-64ac2894-1ecb-4b8b-8510-e96a27ab89b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:27.215006 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-64ac2894-1ecb-4b8b-8510-e96a27ab89b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:27.215366 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-64ac2894-1ecb-4b8b-8510-e96a27ab89b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:27.217169 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-64ac2894-1ecb-4b8b-8510-e96a27ab89b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:27.217950 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-64ac2894-1ecb-4b8b-8510-e96a27ab89b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:27.379169 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-64ac2894-1ecb-4b8b-8510-e96a27ab89b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:27.387587 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-64ac2894-1ecb-4b8b-8510-e96a27ab89b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:27.389082 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-64ac2894-1ecb-4b8b-8510-e96a27ab89b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:27.390192 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-64ac2894-1ecb-4b8b-8510-e96a27ab89b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1406 microversion: 2.20 time: 0.189214 Dec 15 13:04:27.390802 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 38/63] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:04:27 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:04:27.486341 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-9214d125-da78-4063-a4ef-9683838cd95a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:27.487157 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-9214d125-da78-4063-a4ef-9683838cd95a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:27.494184 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9214d125-da78-4063-a4ef-9683838cd95a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:27.494845 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9214d125-da78-4063-a4ef-9683838cd95a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:27.495640 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9214d125-da78-4063-a4ef-9683838cd95a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:27.496242 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9214d125-da78-4063-a4ef-9683838cd95a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:27.562710 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-3f47e8b3-9f38-4885-9c92-4d29d42f3196 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:27.563345 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-3f47e8b3-9f38-4885-9c92-4d29d42f3196 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:27.569892 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3f47e8b3-9f38-4885-9c92-4d29d42f3196 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:27.570375 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3f47e8b3-9f38-4885-9c92-4d29d42f3196 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:27.571310 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3f47e8b3-9f38-4885-9c92-4d29d42f3196 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:27.571740 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3f47e8b3-9f38-4885-9c92-4d29d42f3196 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:27.645275 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-9214d125-da78-4063-a4ef-9683838cd95a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:27.653435 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-9214d125-da78-4063-a4ef-9683838cd95a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1363 microversion: 2.1 time: 0.172495 Dec 15 13:04:27.662970 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 26/64] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:27 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:27.708720 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-3f47e8b3-9f38-4885-9c92-4d29d42f3196 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9417502138f842d7aab2759e0963cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aee9b9928841cfb7feb62018fc0629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:27.715809 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-3f47e8b3-9f38-4885-9c92-4d29d42f3196 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 200 len: 1314 microversion: 2.1 time: 0.157110 Dec 15 13:04:27.716365 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 39/65] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:27 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:27.870692 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-81d0dcd8-1493-4f65-a6ef-f142ef2bb0c8 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:27.872081 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-81d0dcd8-1493-4f65-a6ef-f142ef2bb0c8 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:27.878016 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-81d0dcd8-1493-4f65-a6ef-f142ef2bb0c8 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:27.878551 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-81d0dcd8-1493-4f65-a6ef-f142ef2bb0c8 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:27.879346 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-81d0dcd8-1493-4f65-a6ef-f142ef2bb0c8 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:27.879783 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-81d0dcd8-1493-4f65-a6ef-f142ef2bb0c8 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:28.022450 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-81d0dcd8-1493-4f65-a6ef-f142ef2bb0c8 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:28.029877 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-81d0dcd8-1493-4f65-a6ef-f142ef2bb0c8 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 200 len: 1317 microversion: 2.1 time: 0.162709 Dec 15 13:04:28.030570 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 27/66] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:27 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:28.409521 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b109fc5a-55e5-4c56-9528-0e7b2c8a40fd tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:28.411597 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b109fc5a-55e5-4c56-9528-0e7b2c8a40fd tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:28.423196 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b109fc5a-55e5-4c56-9528-0e7b2c8a40fd tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:28.424295 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b109fc5a-55e5-4c56-9528-0e7b2c8a40fd tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:28.425374 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b109fc5a-55e5-4c56-9528-0e7b2c8a40fd tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:28.425974 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b109fc5a-55e5-4c56-9528-0e7b2c8a40fd tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:28.606347 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b109fc5a-55e5-4c56-9528-0e7b2c8a40fd tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:28.615513 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b109fc5a-55e5-4c56-9528-0e7b2c8a40fd tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:28.618050 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b109fc5a-55e5-4c56-9528-0e7b2c8a40fd tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:28.619767 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b109fc5a-55e5-4c56-9528-0e7b2c8a40fd tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1406 microversion: 2.20 time: 0.215018 Dec 15 13:04:28.621110 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 40/67] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:04:28 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:04:28.670743 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-e1db6cfc-1dd9-4243-8980-7d173fad3d8e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:28.671663 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-e1db6cfc-1dd9-4243-8980-7d173fad3d8e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:28.680725 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e1db6cfc-1dd9-4243-8980-7d173fad3d8e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:28.681719 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e1db6cfc-1dd9-4243-8980-7d173fad3d8e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:28.682990 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e1db6cfc-1dd9-4243-8980-7d173fad3d8e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:28.683779 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e1db6cfc-1dd9-4243-8980-7d173fad3d8e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:28.736476 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-2db6b78f-280c-44c8-9f92-b647f3aa2ddd tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:28.737342 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-2db6b78f-280c-44c8-9f92-b647f3aa2ddd tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:28.752527 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2db6b78f-280c-44c8-9f92-b647f3aa2ddd tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:28.752973 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2db6b78f-280c-44c8-9f92-b647f3aa2ddd tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:28.754422 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2db6b78f-280c-44c8-9f92-b647f3aa2ddd tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:28.754862 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2db6b78f-280c-44c8-9f92-b647f3aa2ddd tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:28.940271 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-2db6b78f-280c-44c8-9f92-b647f3aa2ddd tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9417502138f842d7aab2759e0963cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aee9b9928841cfb7feb62018fc0629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:28.960823 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-2db6b78f-280c-44c8-9f92-b647f3aa2ddd tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 200 len: 1314 microversion: 2.1 time: 0.228179 Dec 15 13:04:28.974800 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 41/68] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:28 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:28.975276 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-e1db6cfc-1dd9-4243-8980-7d173fad3d8e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:28.982192 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-0924cfab-3a68-4b3d-8e5c-799f04d2853e req-3dc2b78d-7566-413f-aee7-df6e011b0b87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d29665f-f416-4d8b-8a0a-7e1eb1515440", "tag": "290299b4-44f3-4a5d-b1f8-8cd714318502"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:04:28.987276 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-e1db6cfc-1dd9-4243-8980-7d173fad3d8e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1363 microversion: 2.1 time: 0.320650 Dec 15 13:04:28.998000 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 28/69] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:28 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1363 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:29.000139 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:04:29.000139 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:04:29.007499 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-0924cfab-3a68-4b3d-8e5c-799f04d2853e req-3dc2b78d-7566-413f-aee7-df6e011b0b87 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:29.007935 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-0924cfab-3a68-4b3d-8e5c-799f04d2853e req-3dc2b78d-7566-413f-aee7-df6e011b0b87 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:29.024968 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-0924cfab-3a68-4b3d-8e5c-799f04d2853e req-3dc2b78d-7566-413f-aee7-df6e011b0b87 service nova] Creating event network-changed:290299b4-44f3-4a5d-b1f8-8cd714318502 for instance 8d29665f-f416-4d8b-8a0a-7e1eb1515440 on hv-cinder-81322 Dec 15 13:04:29.030091 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-0924cfab-3a68-4b3d-8e5c-799f04d2853e req-3dc2b78d-7566-413f-aee7-df6e011b0b87 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059862 Dec 15 13:04:29.030808 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 42/70] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:04:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:04:29.048700 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-1f2f4bf7-c810-4c7a-aab7-fc15aee65f28 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:29.049338 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-1f2f4bf7-c810-4c7a-aab7-fc15aee65f28 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:29.056135 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1f2f4bf7-c810-4c7a-aab7-fc15aee65f28 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:29.056582 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1f2f4bf7-c810-4c7a-aab7-fc15aee65f28 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:29.057370 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1f2f4bf7-c810-4c7a-aab7-fc15aee65f28 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:29.057991 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1f2f4bf7-c810-4c7a-aab7-fc15aee65f28 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:29.257340 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-1f2f4bf7-c810-4c7a-aab7-fc15aee65f28 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:29.268635 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-1f2f4bf7-c810-4c7a-aab7-fc15aee65f28 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 200 len: 1317 microversion: 2.1 time: 0.224535 Dec 15 13:04:29.275735 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 29/71] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:29 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:29.640432 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-018c4403-b23d-4bcf-ab01-4bedbbf50809 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:29.641726 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-018c4403-b23d-4bcf-ab01-4bedbbf50809 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:29.650488 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-018c4403-b23d-4bcf-ab01-4bedbbf50809 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:29.651160 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-018c4403-b23d-4bcf-ab01-4bedbbf50809 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:29.652125 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-018c4403-b23d-4bcf-ab01-4bedbbf50809 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:29.652797 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-018c4403-b23d-4bcf-ab01-4bedbbf50809 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:29.928568 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-018c4403-b23d-4bcf-ab01-4bedbbf50809 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:29.937049 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-018c4403-b23d-4bcf-ab01-4bedbbf50809 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:29.938623 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-018c4403-b23d-4bcf-ab01-4bedbbf50809 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:29.939735 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-018c4403-b23d-4bcf-ab01-4bedbbf50809 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1406 microversion: 2.20 time: 0.303386 Dec 15 13:04:29.940289 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 43/72] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:04:29 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1406 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:04:29.981678 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-3ba33d5e-baba-4f07-8237-3b5033f95594 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:29.982316 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-3ba33d5e-baba-4f07-8237-3b5033f95594 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:29.988449 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3ba33d5e-baba-4f07-8237-3b5033f95594 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:29.988894 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3ba33d5e-baba-4f07-8237-3b5033f95594 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:29.989663 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3ba33d5e-baba-4f07-8237-3b5033f95594 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:29.990091 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3ba33d5e-baba-4f07-8237-3b5033f95594 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:30.005604 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-63214418-e172-455d-94e2-283304194d35 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:30.007055 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-63214418-e172-455d-94e2-283304194d35 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:30.013289 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-63214418-e172-455d-94e2-283304194d35 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:30.013955 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-63214418-e172-455d-94e2-283304194d35 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:30.014986 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-63214418-e172-455d-94e2-283304194d35 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:30.015836 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-63214418-e172-455d-94e2-283304194d35 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:30.246971 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-63214418-e172-455d-94e2-283304194d35 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:30.255845 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-63214418-e172-455d-94e2-283304194d35 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1363 microversion: 2.1 time: 0.255043 Dec 15 13:04:30.266240 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 44/73] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:29 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1363 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:30.267983 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-3ba33d5e-baba-4f07-8237-3b5033f95594 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9417502138f842d7aab2759e0963cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aee9b9928841cfb7feb62018fc0629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:30.281623 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-3ba33d5e-baba-4f07-8237-3b5033f95594 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 200 len: 1314 microversion: 2.1 time: 0.303438 Dec 15 13:04:30.282565 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 30/74] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:29 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:30.293353 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6d40db91-2fbd-4f11-891b-e2d3b04a08a2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:30.294588 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-6d40db91-2fbd-4f11-891b-e2d3b04a08a2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:30.305564 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6d40db91-2fbd-4f11-891b-e2d3b04a08a2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:30.306425 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6d40db91-2fbd-4f11-891b-e2d3b04a08a2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:30.307604 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6d40db91-2fbd-4f11-891b-e2d3b04a08a2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:30.308603 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6d40db91-2fbd-4f11-891b-e2d3b04a08a2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:30.463322 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-6d40db91-2fbd-4f11-891b-e2d3b04a08a2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:30.472865 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6d40db91-2fbd-4f11-891b-e2d3b04a08a2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 200 len: 1317 microversion: 2.1 time: 0.184070 Dec 15 13:04:30.473578 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 45/75] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:30 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:04:30.958369 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-a4fe5c4a-88cf-4de3-a154-4ca32ddec5c5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:30.959224 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-a4fe5c4a-88cf-4de3-a154-4ca32ddec5c5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:30.965134 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a4fe5c4a-88cf-4de3-a154-4ca32ddec5c5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:30.965597 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a4fe5c4a-88cf-4de3-a154-4ca32ddec5c5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:30.967118 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a4fe5c4a-88cf-4de3-a154-4ca32ddec5c5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:30.967639 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a4fe5c4a-88cf-4de3-a154-4ca32ddec5c5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:31.118310 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-a4fe5c4a-88cf-4de3-a154-4ca32ddec5c5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:31.126627 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-a4fe5c4a-88cf-4de3-a154-4ca32ddec5c5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:31.128172 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-a4fe5c4a-88cf-4de3-a154-4ca32ddec5c5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:31.129308 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-a4fe5c4a-88cf-4de3-a154-4ca32ddec5c5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1406 microversion: 2.20 time: 0.174849 Dec 15 13:04:31.129889 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 31/76] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:04:30 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:04:31.273011 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1814f01d-1ad6-4fbf-a324-52a627b4c06d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:31.273838 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1814f01d-1ad6-4fbf-a324-52a627b4c06d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:31.281862 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1814f01d-1ad6-4fbf-a324-52a627b4c06d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:31.282486 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1814f01d-1ad6-4fbf-a324-52a627b4c06d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:31.283795 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1814f01d-1ad6-4fbf-a324-52a627b4c06d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:31.285152 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1814f01d-1ad6-4fbf-a324-52a627b4c06d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:31.305529 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-2310530d-2c34-4a20-8e17-2518200c6650 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:31.306184 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-2310530d-2c34-4a20-8e17-2518200c6650 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:31.313281 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2310530d-2c34-4a20-8e17-2518200c6650 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:31.313733 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2310530d-2c34-4a20-8e17-2518200c6650 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:31.314575 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2310530d-2c34-4a20-8e17-2518200c6650 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:31.314999 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2310530d-2c34-4a20-8e17-2518200c6650 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:31.478366 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1814f01d-1ad6-4fbf-a324-52a627b4c06d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:31.488496 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1814f01d-1ad6-4fbf-a324-52a627b4c06d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1363 microversion: 2.1 time: 0.219561 Dec 15 13:04:31.489655 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 46/77] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:31 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:04:31.494305 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-887f839f-b773-4e0e-9e34-d40cb7b41f39 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:31.495245 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-887f839f-b773-4e0e-9e34-d40cb7b41f39 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:31.502427 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-887f839f-b773-4e0e-9e34-d40cb7b41f39 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:31.502955 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-887f839f-b773-4e0e-9e34-d40cb7b41f39 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:31.503858 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-887f839f-b773-4e0e-9e34-d40cb7b41f39 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:31.504176 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-2310530d-2c34-4a20-8e17-2518200c6650 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9417502138f842d7aab2759e0963cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aee9b9928841cfb7feb62018fc0629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:31.504414 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-887f839f-b773-4e0e-9e34-d40cb7b41f39 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:31.512555 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-2310530d-2c34-4a20-8e17-2518200c6650 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 200 len: 1314 microversion: 2.1 time: 0.215624 Dec 15 13:04:31.513445 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 32/78] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:31 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:31.692415 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-887f839f-b773-4e0e-9e34-d40cb7b41f39 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:31.700819 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-887f839f-b773-4e0e-9e34-d40cb7b41f39 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 200 len: 1317 microversion: 2.1 time: 0.209867 Dec 15 13:04:31.701401 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 47/79] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:31 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:32.155057 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-c22ba2c7-b656-4965-90ff-9ab5a318cf26 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:32.156330 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-c22ba2c7-b656-4965-90ff-9ab5a318cf26 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:32.162662 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c22ba2c7-b656-4965-90ff-9ab5a318cf26 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:32.163185 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c22ba2c7-b656-4965-90ff-9ab5a318cf26 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:32.164005 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c22ba2c7-b656-4965-90ff-9ab5a318cf26 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:32.164439 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c22ba2c7-b656-4965-90ff-9ab5a318cf26 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:32.300728 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-c22ba2c7-b656-4965-90ff-9ab5a318cf26 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:32.308974 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-c22ba2c7-b656-4965-90ff-9ab5a318cf26 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:32.310515 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-c22ba2c7-b656-4965-90ff-9ab5a318cf26 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:32.311614 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-c22ba2c7-b656-4965-90ff-9ab5a318cf26 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1406 microversion: 2.20 time: 0.168390 Dec 15 13:04:32.312167 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 33/80] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:04:32 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:04:32.505180 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f89820cd-e86d-4b71-94a1-fcb21be633ea tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:32.505795 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f89820cd-e86d-4b71-94a1-fcb21be633ea tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:32.511628 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f89820cd-e86d-4b71-94a1-fcb21be633ea tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:32.512077 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f89820cd-e86d-4b71-94a1-fcb21be633ea tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:32.512847 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f89820cd-e86d-4b71-94a1-fcb21be633ea tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:32.513283 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f89820cd-e86d-4b71-94a1-fcb21be633ea tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:32.537124 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-5028800a-ede9-4561-9a75-0a6dfeb56077 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:32.537975 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-5028800a-ede9-4561-9a75-0a6dfeb56077 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:32.544297 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5028800a-ede9-4561-9a75-0a6dfeb56077 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:32.544828 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5028800a-ede9-4561-9a75-0a6dfeb56077 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:32.545523 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5028800a-ede9-4561-9a75-0a6dfeb56077 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:32.545957 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5028800a-ede9-4561-9a75-0a6dfeb56077 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:32.649437 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f89820cd-e86d-4b71-94a1-fcb21be633ea tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:32.664295 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f89820cd-e86d-4b71-94a1-fcb21be633ea tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1363 microversion: 2.1 time: 0.162751 Dec 15 13:04:32.664887 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 48/81] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:32 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:04:32.717723 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d8111f1a-4764-4dc2-8dd4-ea597920f342 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:32.718374 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d8111f1a-4764-4dc2-8dd4-ea597920f342 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:32.725680 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-5028800a-ede9-4561-9a75-0a6dfeb56077 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9417502138f842d7aab2759e0963cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aee9b9928841cfb7feb62018fc0629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:32.725843 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d8111f1a-4764-4dc2-8dd4-ea597920f342 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:32.726503 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d8111f1a-4764-4dc2-8dd4-ea597920f342 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:32.727862 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d8111f1a-4764-4dc2-8dd4-ea597920f342 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:32.728624 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d8111f1a-4764-4dc2-8dd4-ea597920f342 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:32.732848 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-5028800a-ede9-4561-9a75-0a6dfeb56077 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 200 len: 1314 microversion: 2.1 time: 0.199869 Dec 15 13:04:32.733412 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 34/82] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:32 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:04:32.934332 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d8111f1a-4764-4dc2-8dd4-ea597920f342 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:32.945855 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d8111f1a-4764-4dc2-8dd4-ea597920f342 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 200 len: 1317 microversion: 2.1 time: 0.231190 Dec 15 13:04:32.946930 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 49/83] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:32 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:04:33.237733 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-3c704ffc-e2bc-4059-a5bc-6780cb39a3fc req-e1a8cc66-deea-4239-afb7-8c565b758a0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8306f62d-ed9e-459a-b0e8-3d5c2fbffd36", "name": "network-vif-plugged", "status": "completed", "tag": "e7607ece-d8d6-4ca2-bec8-01ff0516ff27"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:04:33.239351 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:04:33.239351 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:04:33.246559 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-3c704ffc-e2bc-4059-a5bc-6780cb39a3fc req-e1a8cc66-deea-4239-afb7-8c565b758a0a service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:33.247088 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-3c704ffc-e2bc-4059-a5bc-6780cb39a3fc req-e1a8cc66-deea-4239-afb7-8c565b758a0a service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:33.260332 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-3c704ffc-e2bc-4059-a5bc-6780cb39a3fc req-e1a8cc66-deea-4239-afb7-8c565b758a0a service nova] Creating event network-vif-plugged:e7607ece-d8d6-4ca2-bec8-01ff0516ff27 for instance 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 on hv-cinder-81322 Dec 15 13:04:33.265509 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-3c704ffc-e2bc-4059-a5bc-6780cb39a3fc req-e1a8cc66-deea-4239-afb7-8c565b758a0a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090942 Dec 15 13:04:33.266195 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 35/84] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:04:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:04:33.333302 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-745022f8-4157-48b4-bfcf-6c574831af38 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:33.333953 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-745022f8-4157-48b4-bfcf-6c574831af38 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:33.339751 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-745022f8-4157-48b4-bfcf-6c574831af38 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:33.340195 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-745022f8-4157-48b4-bfcf-6c574831af38 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:33.340976 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-745022f8-4157-48b4-bfcf-6c574831af38 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:33.341512 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-745022f8-4157-48b4-bfcf-6c574831af38 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:33.470203 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-745022f8-4157-48b4-bfcf-6c574831af38 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:33.478613 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-745022f8-4157-48b4-bfcf-6c574831af38 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:33.480123 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-745022f8-4157-48b4-bfcf-6c574831af38 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:33.481207 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-745022f8-4157-48b4-bfcf-6c574831af38 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1406 microversion: 2.20 time: 0.152717 Dec 15 13:04:33.481757 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 50/85] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:04:33 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:04:33.681122 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-fb50786b-b210-4c76-8be0-876c0b59017c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:33.681743 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-fb50786b-b210-4c76-8be0-876c0b59017c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:33.688000 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fb50786b-b210-4c76-8be0-876c0b59017c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:33.688445 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fb50786b-b210-4c76-8be0-876c0b59017c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:33.689221 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fb50786b-b210-4c76-8be0-876c0b59017c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:33.689650 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fb50786b-b210-4c76-8be0-876c0b59017c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:33.750427 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-76e7a263-e44f-4525-9399-9772bc8a4a49 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:33.751046 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-76e7a263-e44f-4525-9399-9772bc8a4a49 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:33.757320 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76e7a263-e44f-4525-9399-9772bc8a4a49 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:33.757766 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76e7a263-e44f-4525-9399-9772bc8a4a49 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:33.758586 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76e7a263-e44f-4525-9399-9772bc8a4a49 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:33.759017 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76e7a263-e44f-4525-9399-9772bc8a4a49 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:33.884989 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-fb50786b-b210-4c76-8be0-876c0b59017c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:33.899328 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-fb50786b-b210-4c76-8be0-876c0b59017c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1363 microversion: 2.1 time: 0.222157 Dec 15 13:04:33.899945 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 36/86] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:33 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:33.953412 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-76e7a263-e44f-4525-9399-9772bc8a4a49 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9417502138f842d7aab2759e0963cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aee9b9928841cfb7feb62018fc0629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:33.961959 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-76e7a263-e44f-4525-9399-9772bc8a4a49 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 200 len: 1314 microversion: 2.1 time: 0.215310 Dec 15 13:04:33.962568 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 51/87] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:33 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:33.975623 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-9834c7ff-393a-4385-abd8-a417b3272970 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:33.976241 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-9834c7ff-393a-4385-abd8-a417b3272970 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:33.982576 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9834c7ff-393a-4385-abd8-a417b3272970 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:33.983025 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9834c7ff-393a-4385-abd8-a417b3272970 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:33.983811 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9834c7ff-393a-4385-abd8-a417b3272970 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:33.984247 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9834c7ff-393a-4385-abd8-a417b3272970 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:34.180589 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-9834c7ff-393a-4385-abd8-a417b3272970 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:34.188686 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-9834c7ff-393a-4385-abd8-a417b3272970 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 200 len: 1317 microversion: 2.1 time: 0.220638 Dec 15 13:04:34.189492 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 37/88] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:33 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:34.499434 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1c4fdefa-a6c6-4b06-93b3-c96313e49be3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:34.499954 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1c4fdefa-a6c6-4b06-93b3-c96313e49be3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:34.506223 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1c4fdefa-a6c6-4b06-93b3-c96313e49be3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:34.506670 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1c4fdefa-a6c6-4b06-93b3-c96313e49be3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:34.507438 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1c4fdefa-a6c6-4b06-93b3-c96313e49be3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:34.507871 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1c4fdefa-a6c6-4b06-93b3-c96313e49be3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:34.633571 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1c4fdefa-a6c6-4b06-93b3-c96313e49be3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:34.641203 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1c4fdefa-a6c6-4b06-93b3-c96313e49be3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:34.642736 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1c4fdefa-a6c6-4b06-93b3-c96313e49be3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:34.644343 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1c4fdefa-a6c6-4b06-93b3-c96313e49be3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1406 microversion: 2.20 time: 0.148168 Dec 15 13:04:34.644893 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 52/89] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:04:34 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:04:34.915964 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-974098d1-ef33-4179-a1dd-28f0930a3575 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:34.916619 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-974098d1-ef33-4179-a1dd-28f0930a3575 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:34.923674 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-974098d1-ef33-4179-a1dd-28f0930a3575 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:34.924460 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-974098d1-ef33-4179-a1dd-28f0930a3575 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:34.925600 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-974098d1-ef33-4179-a1dd-28f0930a3575 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:34.926192 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-974098d1-ef33-4179-a1dd-28f0930a3575 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:34.989531 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-80bb4fcd-e460-4ad9-ae53-41d8e4c90a5a tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:34.990880 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-80bb4fcd-e460-4ad9-ae53-41d8e4c90a5a tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:35.002708 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-80bb4fcd-e460-4ad9-ae53-41d8e4c90a5a tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:35.004515 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-80bb4fcd-e460-4ad9-ae53-41d8e4c90a5a tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:35.006457 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-80bb4fcd-e460-4ad9-ae53-41d8e4c90a5a tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:35.007259 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-80bb4fcd-e460-4ad9-ae53-41d8e4c90a5a tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:35.104927 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-974098d1-ef33-4179-a1dd-28f0930a3575 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:35.113149 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-974098d1-ef33-4179-a1dd-28f0930a3575 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1363 microversion: 2.1 time: 0.200098 Dec 15 13:04:35.113798 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 38/90] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:34 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:35.175489 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-80bb4fcd-e460-4ad9-ae53-41d8e4c90a5a tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9417502138f842d7aab2759e0963cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aee9b9928841cfb7feb62018fc0629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:35.190001 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-80bb4fcd-e460-4ad9-ae53-41d8e4c90a5a tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 200 len: 1314 microversion: 2.1 time: 0.207519 Dec 15 13:04:35.190687 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 53/91] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:34 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:35.215744 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-53b08d2d-cf82-4596-aca5-9f5eb399fab7 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:35.216827 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-53b08d2d-cf82-4596-aca5-9f5eb399fab7 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:35.226240 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-53b08d2d-cf82-4596-aca5-9f5eb399fab7 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:35.227130 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-53b08d2d-cf82-4596-aca5-9f5eb399fab7 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:35.228349 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-53b08d2d-cf82-4596-aca5-9f5eb399fab7 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:35.229215 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-53b08d2d-cf82-4596-aca5-9f5eb399fab7 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:35.365846 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-9d84ef1e-6d73-44d3-bd24-8d8d17ece34d req-4ca4685b-eb76-411b-833d-a00532e1f6f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff", "name": "network-vif-plugged", "status": "completed", "tag": "5b7da152-6ada-44e9-b82c-2cd8bd9b0213"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:04:35.368616 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:04:35.368616 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:04:35.378903 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-9d84ef1e-6d73-44d3-bd24-8d8d17ece34d req-4ca4685b-eb76-411b-833d-a00532e1f6f9 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:35.379566 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-9d84ef1e-6d73-44d3-bd24-8d8d17ece34d req-4ca4685b-eb76-411b-833d-a00532e1f6f9 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:35.381694 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-53b08d2d-cf82-4596-aca5-9f5eb399fab7 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:35.391389 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-53b08d2d-cf82-4596-aca5-9f5eb399fab7 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 200 len: 1317 microversion: 2.1 time: 0.181419 Dec 15 13:04:35.393454 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-9d84ef1e-6d73-44d3-bd24-8d8d17ece34d req-4ca4685b-eb76-411b-833d-a00532e1f6f9 service nova] Creating event network-vif-plugged:5b7da152-6ada-44e9-b82c-2cd8bd9b0213 for instance fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff on hv-cinder-81322 Dec 15 13:04:35.399339 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 39/92] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:35 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:35.399877 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-9d84ef1e-6d73-44d3-bd24-8d8d17ece34d req-4ca4685b-eb76-411b-833d-a00532e1f6f9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039788 Dec 15 13:04:35.400467 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 54/93] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:04:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:04:35.663035 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-27ee960a-d7c2-4108-a8e2-eea3e7eb4d31 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:35.663637 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-27ee960a-d7c2-4108-a8e2-eea3e7eb4d31 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:35.669503 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-27ee960a-d7c2-4108-a8e2-eea3e7eb4d31 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:35.669952 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-27ee960a-d7c2-4108-a8e2-eea3e7eb4d31 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:35.670750 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-27ee960a-d7c2-4108-a8e2-eea3e7eb4d31 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:35.671182 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-27ee960a-d7c2-4108-a8e2-eea3e7eb4d31 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:35.800508 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-27ee960a-d7c2-4108-a8e2-eea3e7eb4d31 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:35.808332 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-27ee960a-d7c2-4108-a8e2-eea3e7eb4d31 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:35.809848 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-27ee960a-d7c2-4108-a8e2-eea3e7eb4d31 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:35.810984 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-27ee960a-d7c2-4108-a8e2-eea3e7eb4d31 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1406 microversion: 2.20 time: 0.152229 Dec 15 13:04:35.811539 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 40/94] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:04:35 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:04:36.130470 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-920469f7-561d-4cfb-8c90-192eddf9a57f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:36.131152 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-920469f7-561d-4cfb-8c90-192eddf9a57f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:36.137370 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-920469f7-561d-4cfb-8c90-192eddf9a57f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:36.137851 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-920469f7-561d-4cfb-8c90-192eddf9a57f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:36.138682 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-920469f7-561d-4cfb-8c90-192eddf9a57f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:36.139118 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-920469f7-561d-4cfb-8c90-192eddf9a57f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:36.215155 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-9e9557bc-c710-47d4-8af0-6507db10e95f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:36.216107 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-9e9557bc-c710-47d4-8af0-6507db10e95f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:36.226208 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9e9557bc-c710-47d4-8af0-6507db10e95f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:36.226993 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9e9557bc-c710-47d4-8af0-6507db10e95f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:36.228397 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9e9557bc-c710-47d4-8af0-6507db10e95f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:36.229162 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9e9557bc-c710-47d4-8af0-6507db10e95f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:36.301117 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-920469f7-561d-4cfb-8c90-192eddf9a57f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:36.308482 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-920469f7-561d-4cfb-8c90-192eddf9a57f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1363 microversion: 2.1 time: 0.181962 Dec 15 13:04:36.309050 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 55/95] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:36 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:36.379613 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-9e9557bc-c710-47d4-8af0-6507db10e95f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9417502138f842d7aab2759e0963cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aee9b9928841cfb7feb62018fc0629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:36.386713 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-9e9557bc-c710-47d4-8af0-6507db10e95f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 200 len: 1314 microversion: 2.1 time: 0.178303 Dec 15 13:04:36.387271 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 41/96] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:36 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:36.414762 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-438f3377-7d7a-48be-b1b1-9da7b202dbad tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:36.415362 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-438f3377-7d7a-48be-b1b1-9da7b202dbad tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:36.421139 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-438f3377-7d7a-48be-b1b1-9da7b202dbad tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:36.421574 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-438f3377-7d7a-48be-b1b1-9da7b202dbad tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:36.422366 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-438f3377-7d7a-48be-b1b1-9da7b202dbad tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:36.422792 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-438f3377-7d7a-48be-b1b1-9da7b202dbad tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:36.554211 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-438f3377-7d7a-48be-b1b1-9da7b202dbad tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:36.561312 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-438f3377-7d7a-48be-b1b1-9da7b202dbad tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 200 len: 1317 microversion: 2.1 time: 0.150155 Dec 15 13:04:36.561872 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 56/97] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:36 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:04:36.828626 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-2a4f897f-1016-4fb4-bce9-cea8ff7e6ce0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:36.829221 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-2a4f897f-1016-4fb4-bce9-cea8ff7e6ce0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:36.835064 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2a4f897f-1016-4fb4-bce9-cea8ff7e6ce0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:36.835501 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2a4f897f-1016-4fb4-bce9-cea8ff7e6ce0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:36.836260 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2a4f897f-1016-4fb4-bce9-cea8ff7e6ce0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:36.836690 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2a4f897f-1016-4fb4-bce9-cea8ff7e6ce0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:36.970347 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-2a4f897f-1016-4fb4-bce9-cea8ff7e6ce0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:36.978530 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-2a4f897f-1016-4fb4-bce9-cea8ff7e6ce0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:36.980020 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-2a4f897f-1016-4fb4-bce9-cea8ff7e6ce0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:36.981102 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-2a4f897f-1016-4fb4-bce9-cea8ff7e6ce0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1406 microversion: 2.20 time: 0.156139 Dec 15 13:04:36.981668 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 42/98] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:04:36 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:04:37.334224 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-490e5a9a-5cf0-4fd6-83e6-308b51277a91 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:37.335419 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-490e5a9a-5cf0-4fd6-83e6-308b51277a91 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:37.347792 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-490e5a9a-5cf0-4fd6-83e6-308b51277a91 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:37.348534 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-490e5a9a-5cf0-4fd6-83e6-308b51277a91 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:37.350132 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-490e5a9a-5cf0-4fd6-83e6-308b51277a91 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:37.351300 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-490e5a9a-5cf0-4fd6-83e6-308b51277a91 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:37.411710 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-870f1533-87f9-4484-bcf6-56cf10da2beb tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:37.415249 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-870f1533-87f9-4484-bcf6-56cf10da2beb tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:37.431867 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-870f1533-87f9-4484-bcf6-56cf10da2beb tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:37.432319 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-870f1533-87f9-4484-bcf6-56cf10da2beb tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:37.433110 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-870f1533-87f9-4484-bcf6-56cf10da2beb tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:37.433541 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-870f1533-87f9-4484-bcf6-56cf10da2beb tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:37.565132 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-490e5a9a-5cf0-4fd6-83e6-308b51277a91 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:37.578842 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-490e5a9a-5cf0-4fd6-83e6-308b51277a91 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1363 microversion: 2.1 time: 0.254397 Dec 15 13:04:37.579975 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 57/99] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:37 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1363 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:04:37.592812 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c735e05d-8d69-4c83-affa-007b6f21142e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:37.593607 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c735e05d-8d69-4c83-affa-007b6f21142e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:37.600489 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c735e05d-8d69-4c83-affa-007b6f21142e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:37.601026 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c735e05d-8d69-4c83-affa-007b6f21142e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:37.601869 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c735e05d-8d69-4c83-affa-007b6f21142e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:37.602435 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c735e05d-8d69-4c83-affa-007b6f21142e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:37.663583 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-870f1533-87f9-4484-bcf6-56cf10da2beb tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9417502138f842d7aab2759e0963cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aee9b9928841cfb7feb62018fc0629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:37.679837 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-870f1533-87f9-4484-bcf6-56cf10da2beb tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 200 len: 1314 microversion: 2.1 time: 0.278824 Dec 15 13:04:37.680739 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 43/100] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:37 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:37.850634 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c735e05d-8d69-4c83-affa-007b6f21142e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:37.861332 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c735e05d-8d69-4c83-affa-007b6f21142e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 200 len: 1317 microversion: 2.1 time: 0.278433 Dec 15 13:04:37.862197 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 58/101] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:37 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 1317 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:37.999108 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-7f9b42e5-59ec-4317-8768-ada04ef9bf1f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:37.999725 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-7f9b42e5-59ec-4317-8768-ada04ef9bf1f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:38.005884 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7f9b42e5-59ec-4317-8768-ada04ef9bf1f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:38.006474 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7f9b42e5-59ec-4317-8768-ada04ef9bf1f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:38.007419 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7f9b42e5-59ec-4317-8768-ada04ef9bf1f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:38.008838 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7f9b42e5-59ec-4317-8768-ada04ef9bf1f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:38.161579 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-7f9b42e5-59ec-4317-8768-ada04ef9bf1f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:38.175423 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-7f9b42e5-59ec-4317-8768-ada04ef9bf1f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:38.178056 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-7f9b42e5-59ec-4317-8768-ada04ef9bf1f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:38.181064 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-7f9b42e5-59ec-4317-8768-ada04ef9bf1f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1406 microversion: 2.20 time: 0.185051 Dec 15 13:04:38.182325 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 44/102] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:04:37 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1406 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:04:38.597764 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-891790e4-450b-4dc9-93d7-e5df725e7cb4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:38.598420 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-891790e4-450b-4dc9-93d7-e5df725e7cb4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:38.604359 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-891790e4-450b-4dc9-93d7-e5df725e7cb4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:38.604856 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-891790e4-450b-4dc9-93d7-e5df725e7cb4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:38.605673 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-891790e4-450b-4dc9-93d7-e5df725e7cb4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:38.606274 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-891790e4-450b-4dc9-93d7-e5df725e7cb4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:38.703164 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-d3d9153c-8495-43ed-a56a-8a5c433847cc tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:38.705215 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-d3d9153c-8495-43ed-a56a-8a5c433847cc tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:38.720869 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d3d9153c-8495-43ed-a56a-8a5c433847cc tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:38.722618 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d3d9153c-8495-43ed-a56a-8a5c433847cc tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:38.724343 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d3d9153c-8495-43ed-a56a-8a5c433847cc tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:38.725932 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d3d9153c-8495-43ed-a56a-8a5c433847cc tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:38.761583 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-891790e4-450b-4dc9-93d7-e5df725e7cb4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:38.774465 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-891790e4-450b-4dc9-93d7-e5df725e7cb4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1363 microversion: 2.1 time: 0.180625 Dec 15 13:04:38.775329 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 59/103] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:38 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:38.882602 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c5078d38-198a-4355-88e2-c0829c1b4b13 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:38.883551 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c5078d38-198a-4355-88e2-c0829c1b4b13 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:38.891114 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c5078d38-198a-4355-88e2-c0829c1b4b13 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:38.891767 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c5078d38-198a-4355-88e2-c0829c1b4b13 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:38.893210 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c5078d38-198a-4355-88e2-c0829c1b4b13 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:38.894124 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c5078d38-198a-4355-88e2-c0829c1b4b13 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:39.035649 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-d3d9153c-8495-43ed-a56a-8a5c433847cc tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9417502138f842d7aab2759e0963cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aee9b9928841cfb7feb62018fc0629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:39.074654 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-d3d9153c-8495-43ed-a56a-8a5c433847cc tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 200 len: 1314 microversion: 2.1 time: 0.381095 Dec 15 13:04:39.075736 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 45/104] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:38 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:39.213249 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-dc3a240a-8118-45f9-a57e-8a17dec746c2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:39.214365 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-dc3a240a-8118-45f9-a57e-8a17dec746c2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:39.228849 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dc3a240a-8118-45f9-a57e-8a17dec746c2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:39.229633 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dc3a240a-8118-45f9-a57e-8a17dec746c2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:39.242139 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dc3a240a-8118-45f9-a57e-8a17dec746c2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:39.243074 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dc3a240a-8118-45f9-a57e-8a17dec746c2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:39.434198 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c5078d38-198a-4355-88e2-c0829c1b4b13 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:39.447900 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c5078d38-198a-4355-88e2-c0829c1b4b13 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 200 len: 1317 microversion: 2.1 time: 0.570009 Dec 15 13:04:39.448495 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 60/105] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:38 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 1317 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:04:39.537898 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-dc3a240a-8118-45f9-a57e-8a17dec746c2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:39.547252 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-dc3a240a-8118-45f9-a57e-8a17dec746c2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:39.549226 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-dc3a240a-8118-45f9-a57e-8a17dec746c2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:39.551434 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-dc3a240a-8118-45f9-a57e-8a17dec746c2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1406 microversion: 2.20 time: 0.345191 Dec 15 13:04:39.552811 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 46/106] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:04:39 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1406 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:04:39.776699 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-07063d9c-aab5-470e-8847-ee76d021b6a2 req-6a2df455-2feb-4eda-ba66-d9d7d670af80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d29665f-f416-4d8b-8a0a-7e1eb1515440", "name": "network-vif-plugged", "status": "completed", "tag": "290299b4-44f3-4a5d-b1f8-8cd714318502"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:04:39.785640 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:04:39.785640 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:04:39.805229 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-df6ffc7f-0948-40c1-b728-e8d25e08a256 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:39.806591 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-df6ffc7f-0948-40c1-b728-e8d25e08a256 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:39.814673 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-07063d9c-aab5-470e-8847-ee76d021b6a2 req-6a2df455-2feb-4eda-ba66-d9d7d670af80 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:39.820094 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-df6ffc7f-0948-40c1-b728-e8d25e08a256 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:39.820586 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-df6ffc7f-0948-40c1-b728-e8d25e08a256 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:39.821392 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-df6ffc7f-0948-40c1-b728-e8d25e08a256 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:39.821910 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-df6ffc7f-0948-40c1-b728-e8d25e08a256 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:39.825754 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-07063d9c-aab5-470e-8847-ee76d021b6a2 req-6a2df455-2feb-4eda-ba66-d9d7d670af80 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:39.856102 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-07063d9c-aab5-470e-8847-ee76d021b6a2 req-6a2df455-2feb-4eda-ba66-d9d7d670af80 service nova] Creating event network-vif-plugged:290299b4-44f3-4a5d-b1f8-8cd714318502 for instance 8d29665f-f416-4d8b-8a0a-7e1eb1515440 on hv-cinder-81322 Dec 15 13:04:39.873725 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-07063d9c-aab5-470e-8847-ee76d021b6a2 req-6a2df455-2feb-4eda-ba66-d9d7d670af80 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108970 Dec 15 13:04:39.878415 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 61/107] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:04:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:04:40.094020 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-22d63631-bfcc-42b5-8935-244c94c0308c tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:40.095626 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-22d63631-bfcc-42b5-8935-244c94c0308c tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:40.106117 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-df6ffc7f-0948-40c1-b728-e8d25e08a256 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:40.114870 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-df6ffc7f-0948-40c1-b728-e8d25e08a256 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1363 microversion: 2.1 time: 0.314699 Dec 15 13:04:40.116332 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 47/108] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:39 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1363 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:40.118386 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-22d63631-bfcc-42b5-8935-244c94c0308c tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:40.120005 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-22d63631-bfcc-42b5-8935-244c94c0308c tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:40.123138 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-22d63631-bfcc-42b5-8935-244c94c0308c tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:40.123773 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-22d63631-bfcc-42b5-8935-244c94c0308c tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:40.294657 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-22d63631-bfcc-42b5-8935-244c94c0308c tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9417502138f842d7aab2759e0963cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aee9b9928841cfb7feb62018fc0629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:40.303997 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-22d63631-bfcc-42b5-8935-244c94c0308c tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 200 len: 1501 microversion: 2.1 time: 0.214896 Dec 15 13:04:40.304602 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 62/109] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:40 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 1501 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:40.466719 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-42f09980-93fa-4b0a-8179-04b9f1f052d5 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:40.467810 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-42f09980-93fa-4b0a-8179-04b9f1f052d5 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:40.478176 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-42f09980-93fa-4b0a-8179-04b9f1f052d5 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:40.478828 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-42f09980-93fa-4b0a-8179-04b9f1f052d5 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:40.480077 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-42f09980-93fa-4b0a-8179-04b9f1f052d5 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:40.481011 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-42f09980-93fa-4b0a-8179-04b9f1f052d5 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:40.571420 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4448c307-5a0a-49fe-84f7-c4dfe3ef2adf tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:40.572329 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4448c307-5a0a-49fe-84f7-c4dfe3ef2adf tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:40.593823 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4448c307-5a0a-49fe-84f7-c4dfe3ef2adf tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:40.597470 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4448c307-5a0a-49fe-84f7-c4dfe3ef2adf tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:40.597470 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4448c307-5a0a-49fe-84f7-c4dfe3ef2adf tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:40.597470 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4448c307-5a0a-49fe-84f7-c4dfe3ef2adf tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:40.689361 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-42f09980-93fa-4b0a-8179-04b9f1f052d5 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:40.698125 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-42f09980-93fa-4b0a-8179-04b9f1f052d5 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 200 len: 1507 microversion: 2.1 time: 0.236673 Dec 15 13:04:40.698732 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 48/110] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:40 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 1507 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:40.811747 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4448c307-5a0a-49fe-84f7-c4dfe3ef2adf tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:40.820484 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4448c307-5a0a-49fe-84f7-c4dfe3ef2adf tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:40.822655 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4448c307-5a0a-49fe-84f7-c4dfe3ef2adf tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:40.824233 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4448c307-5a0a-49fe-84f7-c4dfe3ef2adf tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1406 microversion: 2.20 time: 0.257414 Dec 15 13:04:40.824928 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 63/111] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:04:40 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1406 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:04:41.132559 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-52eb37eb-0da8-4fb7-8c7c-2df20fc9c44c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:41.133198 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-52eb37eb-0da8-4fb7-8c7c-2df20fc9c44c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:41.139144 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-52eb37eb-0da8-4fb7-8c7c-2df20fc9c44c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:41.139598 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-52eb37eb-0da8-4fb7-8c7c-2df20fc9c44c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:41.140374 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-52eb37eb-0da8-4fb7-8c7c-2df20fc9c44c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:41.140809 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-52eb37eb-0da8-4fb7-8c7c-2df20fc9c44c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:41.278194 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-52eb37eb-0da8-4fb7-8c7c-2df20fc9c44c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:41.288716 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-52eb37eb-0da8-4fb7-8c7c-2df20fc9c44c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1363 microversion: 2.1 time: 0.157189 Dec 15 13:04:41.288716 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 49/112] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:41 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:41.841622 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1d13d97d-375d-4aab-9d60-68f7b6594cf8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:41.842272 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1d13d97d-375d-4aab-9d60-68f7b6594cf8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:41.848569 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1d13d97d-375d-4aab-9d60-68f7b6594cf8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:41.849031 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1d13d97d-375d-4aab-9d60-68f7b6594cf8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:41.849815 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1d13d97d-375d-4aab-9d60-68f7b6594cf8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:41.850266 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1d13d97d-375d-4aab-9d60-68f7b6594cf8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:41.978488 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1d13d97d-375d-4aab-9d60-68f7b6594cf8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:41.986618 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1d13d97d-375d-4aab-9d60-68f7b6594cf8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:41.988759 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1d13d97d-375d-4aab-9d60-68f7b6594cf8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:41.990043 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1d13d97d-375d-4aab-9d60-68f7b6594cf8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1406 microversion: 2.20 time: 0.152071 Dec 15 13:04:41.993168 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 64/113] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:04:41 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:04:42.305118 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-acbc7bee-c877-43df-b0c5-bd0f66902e03 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:42.305718 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-acbc7bee-c877-43df-b0c5-bd0f66902e03 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:42.311409 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-acbc7bee-c877-43df-b0c5-bd0f66902e03 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:42.311850 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-acbc7bee-c877-43df-b0c5-bd0f66902e03 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:42.312616 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-acbc7bee-c877-43df-b0c5-bd0f66902e03 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:42.313043 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-acbc7bee-c877-43df-b0c5-bd0f66902e03 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:42.441210 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-acbc7bee-c877-43df-b0c5-bd0f66902e03 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:42.448496 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-acbc7bee-c877-43df-b0c5-bd0f66902e03 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1363 microversion: 2.1 time: 0.146977 Dec 15 13:04:42.449059 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 50/114] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:42 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:43.008038 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-366f3ac0-59be-4bb8-a751-7f24468183ac tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:43.008648 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-366f3ac0-59be-4bb8-a751-7f24468183ac tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:43.014401 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-366f3ac0-59be-4bb8-a751-7f24468183ac tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:43.014850 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-366f3ac0-59be-4bb8-a751-7f24468183ac tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:43.015622 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-366f3ac0-59be-4bb8-a751-7f24468183ac tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:43.016059 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-366f3ac0-59be-4bb8-a751-7f24468183ac tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:43.144832 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-366f3ac0-59be-4bb8-a751-7f24468183ac tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:43.153003 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-366f3ac0-59be-4bb8-a751-7f24468183ac tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:43.154518 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-366f3ac0-59be-4bb8-a751-7f24468183ac tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:43.155924 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-366f3ac0-59be-4bb8-a751-7f24468183ac tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1406 microversion: 2.20 time: 0.151363 Dec 15 13:04:43.156713 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 65/115] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:04:43 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:04:43.465848 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-c501c647-4ec2-42ab-b4ad-ef5838d644fe tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:43.466866 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-c501c647-4ec2-42ab-b4ad-ef5838d644fe tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:43.472569 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c501c647-4ec2-42ab-b4ad-ef5838d644fe tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:43.473071 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c501c647-4ec2-42ab-b4ad-ef5838d644fe tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:43.473842 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c501c647-4ec2-42ab-b4ad-ef5838d644fe tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:43.474301 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c501c647-4ec2-42ab-b4ad-ef5838d644fe tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:43.603145 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-c501c647-4ec2-42ab-b4ad-ef5838d644fe tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:43.610389 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-c501c647-4ec2-42ab-b4ad-ef5838d644fe tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1363 microversion: 2.1 time: 0.149027 Dec 15 13:04:43.610950 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 51/116] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:43 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:43.799484 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-321b59c7-3f7c-41aa-bf9c-af3784275424 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b72ea2c4-7224-46aa-8781-99214f6f5c6f"}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:04:43.801360 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-321b59c7-3f7c-41aa-bf9c-af3784275424 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:43.807299 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-321b59c7-3f7c-41aa-bf9c-af3784275424 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:43.807750 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-321b59c7-3f7c-41aa-bf9c-af3784275424 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:43.808534 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-321b59c7-3f7c-41aa-bf9c-af3784275424 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:43.808966 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-321b59c7-3f7c-41aa-bf9c-af3784275424 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:44.136145 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-321b59c7-3f7c-41aa-bf9c-af3784275424 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "POST /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.339588 Dec 15 13:04:44.137079 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 66/117] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Dec 15 13:04:43 2021] POST /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36/os-volume_attachments => generated 194 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:04:44.180644 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-865d7fc5-cd9d-4347-be92-9bc4d2e4d791 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:44.181440 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-865d7fc5-cd9d-4347-be92-9bc4d2e4d791 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:44.188012 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-865d7fc5-cd9d-4347-be92-9bc4d2e4d791 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:44.188467 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-865d7fc5-cd9d-4347-be92-9bc4d2e4d791 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:44.189244 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-865d7fc5-cd9d-4347-be92-9bc4d2e4d791 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:44.190042 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-865d7fc5-cd9d-4347-be92-9bc4d2e4d791 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:44.253658 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8c6ccfcb-3d67-4de1-be4b-65f3fa25a2f5 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "927fcb3e-64e2-42e8-a3ef-6c8d345e32a7"}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:04:44.255386 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8c6ccfcb-3d67-4de1-be4b-65f3fa25a2f5 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:44.269921 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8c6ccfcb-3d67-4de1-be4b-65f3fa25a2f5 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:44.270631 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8c6ccfcb-3d67-4de1-be4b-65f3fa25a2f5 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:44.272813 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8c6ccfcb-3d67-4de1-be4b-65f3fa25a2f5 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:44.273406 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8c6ccfcb-3d67-4de1-be4b-65f3fa25a2f5 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:44.343947 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-865d7fc5-cd9d-4347-be92-9bc4d2e4d791 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:44.354962 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-865d7fc5-cd9d-4347-be92-9bc4d2e4d791 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:44.357156 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-865d7fc5-cd9d-4347-be92-9bc4d2e4d791 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:44.358943 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-865d7fc5-cd9d-4347-be92-9bc4d2e4d791 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1406 microversion: 2.20 time: 0.183883 Dec 15 13:04:44.359495 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 52/118] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:04:44 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:04:44.627852 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-2ec3ff40-47d0-4438-a796-22bb66220093 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:44.628978 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-2ec3ff40-47d0-4438-a796-22bb66220093 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:44.635816 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2ec3ff40-47d0-4438-a796-22bb66220093 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:44.636319 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2ec3ff40-47d0-4438-a796-22bb66220093 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:44.637514 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2ec3ff40-47d0-4438-a796-22bb66220093 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:44.638016 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2ec3ff40-47d0-4438-a796-22bb66220093 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:44.673122 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8c6ccfcb-3d67-4de1-be4b-65f3fa25a2f5 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "POST /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.424519 Dec 15 13:04:44.673911 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 67/119] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Dec 15 13:04:44 2021] POST /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff/os-volume_attachments => generated 194 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:04:44.788421 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-2ec3ff40-47d0-4438-a796-22bb66220093 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:44.799877 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-2ec3ff40-47d0-4438-a796-22bb66220093 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1548 microversion: 2.1 time: 0.175409 Dec 15 13:04:44.801242 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 53/120] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:44 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1548 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:04:44.820501 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-eeb2c8bb-afb8-4c66-8427-d629f045339f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:44.821648 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-eeb2c8bb-afb8-4c66-8427-d629f045339f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:44.828871 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eeb2c8bb-afb8-4c66-8427-d629f045339f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:44.829328 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eeb2c8bb-afb8-4c66-8427-d629f045339f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:44.830168 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eeb2c8bb-afb8-4c66-8427-d629f045339f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:44.830604 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eeb2c8bb-afb8-4c66-8427-d629f045339f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:44.920568 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-eeb2c8bb-afb8-4c66-8427-d629f045339f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105042 Dec 15 13:04:44.921372 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 68/121] 10.222.0.57 () {58 vars in 1274 bytes} [Wed Dec 15 13:04:44 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:04:45.100738 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-057d11cb-d026-43ed-8da5-e6663cbbfc30 req-2b7e3262-0bf1-4320-bb8d-f42d31dd698a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "703b5e88-39f0-436c-ac5a-f1701ec4d7c9", "name": "network-vif-plugged", "status": "completed", "tag": "82fec70a-827b-4ef1-8922-a834a47147e1"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:04:45.102388 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:04:45.102388 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:04:45.114529 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-057d11cb-d026-43ed-8da5-e6663cbbfc30 req-2b7e3262-0bf1-4320-bb8d-f42d31dd698a service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:45.115300 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-057d11cb-d026-43ed-8da5-e6663cbbfc30 req-2b7e3262-0bf1-4320-bb8d-f42d31dd698a service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:45.151728 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-057d11cb-d026-43ed-8da5-e6663cbbfc30 req-2b7e3262-0bf1-4320-bb8d-f42d31dd698a service nova] Creating event network-vif-plugged:82fec70a-827b-4ef1-8922-a834a47147e1 for instance 703b5e88-39f0-436c-ac5a-f1701ec4d7c9 on hv-cinder-81322 Dec 15 13:04:45.160691 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-057d11cb-d026-43ed-8da5-e6663cbbfc30 req-2b7e3262-0bf1-4320-bb8d-f42d31dd698a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063320 Dec 15 13:04:45.161286 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 54/122] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:04:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:04:45.382435 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4462d3cc-1d3f-4e4a-beb4-157a630612a0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:45.385902 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4462d3cc-1d3f-4e4a-beb4-157a630612a0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:45.393203 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4462d3cc-1d3f-4e4a-beb4-157a630612a0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:45.393785 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4462d3cc-1d3f-4e4a-beb4-157a630612a0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:45.395420 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4462d3cc-1d3f-4e4a-beb4-157a630612a0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:45.396650 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4462d3cc-1d3f-4e4a-beb4-157a630612a0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:45.775273 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4462d3cc-1d3f-4e4a-beb4-157a630612a0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:45.783569 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4462d3cc-1d3f-4e4a-beb4-157a630612a0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:45.795291 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4462d3cc-1d3f-4e4a-beb4-157a630612a0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:45.796731 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4462d3cc-1d3f-4e4a-beb4-157a630612a0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1406 microversion: 2.20 time: 0.421147 Dec 15 13:04:45.797368 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 69/123] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:04:45 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1406 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:04:46.466434 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-a317be69-0007-44c1-a362-bf52285cb4b7 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:04:46.467444 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-a317be69-0007-44c1-a362-bf52285cb4b7 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:46.468541 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-612eb2dc-673c-41a4-828a-28530c5c1545 req-4f8bb0a7-5c8f-49fd-9bd4-b6f9ff7b89e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d29665f-f416-4d8b-8a0a-7e1eb1515440", "tag": "290299b4-44f3-4a5d-b1f8-8cd714318502"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:04:46.470840 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:04:46.470840 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:04:46.475216 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a317be69-0007-44c1-a362-bf52285cb4b7 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:46.475840 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a317be69-0007-44c1-a362-bf52285cb4b7 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:46.476727 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a317be69-0007-44c1-a362-bf52285cb4b7 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:46.477170 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a317be69-0007-44c1-a362-bf52285cb4b7 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:46.479806 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-612eb2dc-673c-41a4-828a-28530c5c1545 req-4f8bb0a7-5c8f-49fd-9bd4-b6f9ff7b89e4 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:46.480454 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-612eb2dc-673c-41a4-828a-28530c5c1545 req-4f8bb0a7-5c8f-49fd-9bd4-b6f9ff7b89e4 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:46.496021 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-612eb2dc-673c-41a4-828a-28530c5c1545 req-4f8bb0a7-5c8f-49fd-9bd4-b6f9ff7b89e4 service nova] Creating event network-changed:290299b4-44f3-4a5d-b1f8-8cd714318502 for instance 8d29665f-f416-4d8b-8a0a-7e1eb1515440 on hv-cinder-81322 Dec 15 13:04:46.501907 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-612eb2dc-673c-41a4-828a-28530c5c1545 req-4f8bb0a7-5c8f-49fd-9bd4-b6f9ff7b89e4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036821 Dec 15 13:04:46.503625 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 70/124] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:04:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:04:46.677784 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-a317be69-0007-44c1-a362-bf52285cb4b7 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 14 microversion: 2.1 time: 0.215486 Dec 15 13:04:46.681032 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 55/125] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:04:46 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 14 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:04:46.815675 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9cf658da-c505-4482-bac8-1563a7744091 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:46.816908 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9cf658da-c505-4482-bac8-1563a7744091 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:46.831678 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9cf658da-c505-4482-bac8-1563a7744091 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:46.833612 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9cf658da-c505-4482-bac8-1563a7744091 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:46.836624 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9cf658da-c505-4482-bac8-1563a7744091 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:46.837148 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9cf658da-c505-4482-bac8-1563a7744091 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:47.311707 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-9cf658da-c505-4482-bac8-1563a7744091 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:47.321232 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-9cf658da-c505-4482-bac8-1563a7744091 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:47.325058 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-9cf658da-c505-4482-bac8-1563a7744091 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:47.326330 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9cf658da-c505-4482-bac8-1563a7744091 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1597 microversion: 2.20 time: 0.514856 Dec 15 13:04:47.329311 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 71/126] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:04:46 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1597 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:04:47.348732 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-b9a4fd44-8831-4da2-a005-c8dc55715176 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:47.349461 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-b9a4fd44-8831-4da2-a005-c8dc55715176 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:47.356635 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b9a4fd44-8831-4da2-a005-c8dc55715176 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:47.357180 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b9a4fd44-8831-4da2-a005-c8dc55715176 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:47.358056 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b9a4fd44-8831-4da2-a005-c8dc55715176 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:47.359827 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b9a4fd44-8831-4da2-a005-c8dc55715176 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:47.513941 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-b9a4fd44-8831-4da2-a005-c8dc55715176 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.168959 Dec 15 13:04:47.515762 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 56/127] 10.222.0.57 () {60 vars in 1315 bytes} [Wed Dec 15 13:04:47 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-interface => generated 284 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:04:47.694919 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-03fa05d9-09c8-4bba-b966-a489a66078ae tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:04:47.697694 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-03fa05d9-09c8-4bba-b966-a489a66078ae tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:47.714322 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-03fa05d9-09c8-4bba-b966-a489a66078ae tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:47.715001 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-03fa05d9-09c8-4bba-b966-a489a66078ae tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:47.716818 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-03fa05d9-09c8-4bba-b966-a489a66078ae tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:47.718448 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-03fa05d9-09c8-4bba-b966-a489a66078ae tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:47.788510 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-03fa05d9-09c8-4bba-b966-a489a66078ae tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 14 microversion: 2.1 time: 0.103600 Dec 15 13:04:47.789742 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 72/128] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:04:47 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:04:48.736532 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-b492ada0-dcc5-45ff-975b-f82cd9fcf4e3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:04:48.738716 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-b492ada0-dcc5-45ff-975b-f82cd9fcf4e3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:48.756004 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-7fca2e8d-bed8-4481-b4b5-ff978b52a597 req-50525df2-5d7f-402a-b5ae-59588e6afaf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "703b5e88-39f0-436c-ac5a-f1701ec4d7c9", "tag": "82fec70a-827b-4ef1-8922-a834a47147e1"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:04:48.757685 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:04:48.757685 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:04:48.765727 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-7fca2e8d-bed8-4481-b4b5-ff978b52a597 req-50525df2-5d7f-402a-b5ae-59588e6afaf8 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:48.766347 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-7fca2e8d-bed8-4481-b4b5-ff978b52a597 req-50525df2-5d7f-402a-b5ae-59588e6afaf8 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:48.771794 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b492ada0-dcc5-45ff-975b-f82cd9fcf4e3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:48.772411 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b492ada0-dcc5-45ff-975b-f82cd9fcf4e3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:48.773341 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b492ada0-dcc5-45ff-975b-f82cd9fcf4e3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:48.775002 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b492ada0-dcc5-45ff-975b-f82cd9fcf4e3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:48.780628 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-7fca2e8d-bed8-4481-b4b5-ff978b52a597 req-50525df2-5d7f-402a-b5ae-59588e6afaf8 service nova] Creating event network-changed:82fec70a-827b-4ef1-8922-a834a47147e1 for instance 703b5e88-39f0-436c-ac5a-f1701ec4d7c9 on hv-cinder-81322 Dec 15 13:04:48.787770 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-7fca2e8d-bed8-4481-b4b5-ff978b52a597 req-50525df2-5d7f-402a-b5ae-59588e6afaf8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037307 Dec 15 13:04:48.793000 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 73/129] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:04:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:04:48.806599 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-957ac36a-d80d-4fcc-83fe-723d2f41d790 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:04:48.807931 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-957ac36a-d80d-4fcc-83fe-723d2f41d790 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:48.826740 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-957ac36a-d80d-4fcc-83fe-723d2f41d790 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:48.829576 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-957ac36a-d80d-4fcc-83fe-723d2f41d790 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:48.830591 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-957ac36a-d80d-4fcc-83fe-723d2f41d790 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:48.833089 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-957ac36a-d80d-4fcc-83fe-723d2f41d790 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:48.867676 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-b492ada0-dcc5-45ff-975b-f82cd9fcf4e3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 14 microversion: 2.20 time: 0.135678 Dec 15 13:04:48.868898 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 57/130] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:04:48 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:04:48.924902 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-957ac36a-d80d-4fcc-83fe-723d2f41d790 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 14 microversion: 2.1 time: 0.127623 Dec 15 13:04:48.929098 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 74/131] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:04:48 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:04:49.882102 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-2de39d60-31d3-4d83-a861-710c845ea114 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:04:49.885153 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-2de39d60-31d3-4d83-a861-710c845ea114 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:49.927532 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2de39d60-31d3-4d83-a861-710c845ea114 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:49.928080 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2de39d60-31d3-4d83-a861-710c845ea114 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:49.933179 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2de39d60-31d3-4d83-a861-710c845ea114 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:49.934081 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2de39d60-31d3-4d83-a861-710c845ea114 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:49.941072 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e741ac06-56e2-4024-9fd8-8c95c08e0807 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:04:49.943144 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e741ac06-56e2-4024-9fd8-8c95c08e0807 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:49.952346 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e741ac06-56e2-4024-9fd8-8c95c08e0807 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:49.953822 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e741ac06-56e2-4024-9fd8-8c95c08e0807 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:49.954807 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e741ac06-56e2-4024-9fd8-8c95c08e0807 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:49.955744 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e741ac06-56e2-4024-9fd8-8c95c08e0807 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:50.059075 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-2de39d60-31d3-4d83-a861-710c845ea114 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 14 microversion: 2.20 time: 0.182595 Dec 15 13:04:50.059707 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 58/132] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:04:49 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 14 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:50.068588 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e741ac06-56e2-4024-9fd8-8c95c08e0807 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 14 microversion: 2.1 time: 0.133308 Dec 15 13:04:50.069922 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 75/133] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:04:49 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:04:51.071007 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-8a9a072a-ee9b-4925-9e30-938c20ab0846 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:04:51.072611 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-8a9a072a-ee9b-4925-9e30-938c20ab0846 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:51.079935 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8a9a072a-ee9b-4925-9e30-938c20ab0846 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:51.080466 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8a9a072a-ee9b-4925-9e30-938c20ab0846 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:51.081994 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-07249270-5ee6-419d-8cb7-345179bcaaf6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:04:51.082501 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8a9a072a-ee9b-4925-9e30-938c20ab0846 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:51.082869 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8a9a072a-ee9b-4925-9e30-938c20ab0846 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:51.084633 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-07249270-5ee6-419d-8cb7-345179bcaaf6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:51.093860 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-07249270-5ee6-419d-8cb7-345179bcaaf6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:51.094598 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-07249270-5ee6-419d-8cb7-345179bcaaf6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:51.095547 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-07249270-5ee6-419d-8cb7-345179bcaaf6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:51.096445 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-07249270-5ee6-419d-8cb7-345179bcaaf6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:54.042796 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-8a9a072a-ee9b-4925-9e30-938c20ab0846 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 14 microversion: 2.20 time: 2.976197 Dec 15 13:04:54.046109 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 59/134] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:04:51 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 14 bytes in 2978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:54.065133 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-07249270-5ee6-419d-8cb7-345179bcaaf6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 14 microversion: 2.1 time: 2.988315 Dec 15 13:04:54.067387 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 76/135] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:04:51 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 14 bytes in 2992 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 13:04:54.772058 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-22bb983c-95f2-4370-8d48-39cb6e3efd83 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-71294249", "imageRef": "67890983-693f-44ed-bdf3-22321abeab26", "flavorRef": "452", "networks": [{"uuid": "c3430785-34d0-49f6-8e66-cf155a895b08"}]}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:04:54.839237 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.network.neutron [None req-22bb983c-95f2-4370-8d48-39cb6e3efd83 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] validate_networks() for [('c3430785-34d0-49f6-8e66-cf155a895b08', None, None, None, None, None)] {{(pid=116097) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:04:55.055869 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-42641cb9-19dd-420e-be8e-e8b33edf975b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:04:55.056997 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-42641cb9-19dd-420e-be8e-e8b33edf975b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:55.074803 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-42641cb9-19dd-420e-be8e-e8b33edf975b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:55.075713 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-42641cb9-19dd-420e-be8e-e8b33edf975b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:55.076235 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-42641cb9-19dd-420e-be8e-e8b33edf975b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:55.076678 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-42641cb9-19dd-420e-be8e-e8b33edf975b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:55.171431 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-42641cb9-19dd-420e-be8e-e8b33edf975b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 14 microversion: 2.20 time: 0.119694 Dec 15 13:04:55.172684 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 77/136] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:04:55 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:55.179075 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e53ddcce-d629-4823-a8b8-cef807bccb39 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:04:55.180431 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e53ddcce-d629-4823-a8b8-cef807bccb39 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:55.188236 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e53ddcce-d629-4823-a8b8-cef807bccb39 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:55.189160 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e53ddcce-d629-4823-a8b8-cef807bccb39 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:55.190923 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e53ddcce-d629-4823-a8b8-cef807bccb39 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:55.191694 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e53ddcce-d629-4823-a8b8-cef807bccb39 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:55.281343 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e53ddcce-d629-4823-a8b8-cef807bccb39 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 14 microversion: 2.1 time: 0.106276 Dec 15 13:04:55.282358 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 78/137] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:04:55 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:04:55.351006 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-22bb983c-95f2-4370-8d48-39cb6e3efd83 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Flavor limits 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:04:55.351924 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-22bb983c-95f2-4370-8d48-39cb6e3efd83 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Image limits 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:04:55.352612 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-22bb983c-95f2-4370-8d48-39cb6e3efd83 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Flavor pref 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:04:55.353153 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-22bb983c-95f2-4370-8d48-39cb6e3efd83 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Image pref 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:04:55.353646 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-22bb983c-95f2-4370-8d48-39cb6e3efd83 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:04:55.364149 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-22bb983c-95f2-4370-8d48-39cb6e3efd83 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:55.364673 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-22bb983c-95f2-4370-8d48-39cb6e3efd83 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:55.365575 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-22bb983c-95f2-4370-8d48-39cb6e3efd83 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:55.366424 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-22bb983c-95f2-4370-8d48-39cb6e3efd83 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:55.385522 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-22bb983c-95f2-4370-8d48-39cb6e3efd83 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Getting quotas for project e65fe36399a34538b3b4da9464f43df3. Resources: {'instances', 'cores', 'ram'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:04:55.389917 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-22bb983c-95f2-4370-8d48-39cb6e3efd83 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Getting quotas for user 047982e41574460caa4bf3b79a9a8370 and project e65fe36399a34538b3b4da9464f43df3. Resources: {'instances', 'cores', 'ram'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:04:55.401757 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-22bb983c-95f2-4370-8d48-39cb6e3efd83 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Going to run 1 instances... {{(pid=116097) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:04:55.404312 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-22bb983c-95f2-4370-8d48-39cb6e3efd83 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: 6d7e8b60-2efb-4376-ab88-65f915ebd89f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67890983-693f-44ed-bdf3-22321abeab26',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:04:55.468713 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-22bb983c-95f2-4370-8d48-39cb6e3efd83 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.701237 Dec 15 13:04:55.469773 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 60/138] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Dec 15 13:04:54 2021] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:04:55.481735 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f7b05a71-3940-430c-95bb-3c89dbf4c7f3 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:55.482995 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f7b05a71-3940-430c-95bb-3c89dbf4c7f3 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: 6d7e8b60-2efb-4376-ab88-65f915ebd89f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:55.564086 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f7b05a71-3940-430c-95bb-3c89dbf4c7f3 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:55.575761 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f7b05a71-3940-430c-95bb-3c89dbf4c7f3 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f" status: 200 len: 1217 microversion: 2.1 time: 0.099627 Dec 15 13:04:55.576552 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 79/139] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:55 2021] GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:56.040334 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-23bbcf89-dc37-43d1-bd86-0dee3e181b14 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:56.040833 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-23bbcf89-dc37-43d1-bd86-0dee3e181b14 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:56.046906 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-23bbcf89-dc37-43d1-bd86-0dee3e181b14 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:56.047350 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-23bbcf89-dc37-43d1-bd86-0dee3e181b14 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:56.048135 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-23bbcf89-dc37-43d1-bd86-0dee3e181b14 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:56.048568 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-23bbcf89-dc37-43d1-bd86-0dee3e181b14 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:56.089950 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-23bbcf89-dc37-43d1-bd86-0dee3e181b14 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Going to try to terminate instance {{(pid=116097) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:04:56.182972 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5284264e-9555-4c6a-8305-45eb1f5d70a2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:04:56.184803 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5284264e-9555-4c6a-8305-45eb1f5d70a2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:56.191992 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5284264e-9555-4c6a-8305-45eb1f5d70a2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:56.192898 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5284264e-9555-4c6a-8305-45eb1f5d70a2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:56.194041 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5284264e-9555-4c6a-8305-45eb1f5d70a2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:56.194675 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5284264e-9555-4c6a-8305-45eb1f5d70a2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:56.201648 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-23bbcf89-dc37-43d1-bd86-0dee3e181b14 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 204 len: 0 microversion: 2.1 time: 0.165118 Dec 15 13:04:56.202623 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 61/140] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Dec 15 13:04:56 2021] DELETE /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:04:56.216073 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-97cbbf4c-e505-437d-a6fb-9c944b4e3155 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:56.216880 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-97cbbf4c-e505-437d-a6fb-9c944b4e3155 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:56.224322 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-97cbbf4c-e505-437d-a6fb-9c944b4e3155 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:56.225176 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-97cbbf4c-e505-437d-a6fb-9c944b4e3155 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:56.226240 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-97cbbf4c-e505-437d-a6fb-9c944b4e3155 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:56.226902 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-97cbbf4c-e505-437d-a6fb-9c944b4e3155 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:56.399671 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-97cbbf4c-e505-437d-a6fb-9c944b4e3155 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9417502138f842d7aab2759e0963cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aee9b9928841cfb7feb62018fc0629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:56.408732 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-97cbbf4c-e505-437d-a6fb-9c944b4e3155 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 200 len: 1553 microversion: 2.1 time: 0.200751 Dec 15 13:04:56.418858 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 62/141] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:56 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 1553 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:56.423467 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-96bd03a1-d6c5-4068-84f5-2328779102af tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:04:56.424670 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-96bd03a1-d6c5-4068-84f5-2328779102af tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:56.430458 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-96bd03a1-d6c5-4068-84f5-2328779102af tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:56.430912 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-96bd03a1-d6c5-4068-84f5-2328779102af tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:56.431698 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-96bd03a1-d6c5-4068-84f5-2328779102af tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:56.432130 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-96bd03a1-d6c5-4068-84f5-2328779102af tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:58.557748 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-96bd03a1-d6c5-4068-84f5-2328779102af tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 14 microversion: 2.1 time: 2.137562 Dec 15 13:04:58.561077 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 63/142] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:04:56 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 14 bytes in 2139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:04:58.563746 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-6edcc6b7-b975-4644-8ebb-043c867aefe5 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:58.564443 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-6edcc6b7-b975-4644-8ebb-043c867aefe5 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: 6d7e8b60-2efb-4376-ab88-65f915ebd89f] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:58.571795 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6edcc6b7-b975-4644-8ebb-043c867aefe5 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:58.572245 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6edcc6b7-b975-4644-8ebb-043c867aefe5 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:58.573099 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6edcc6b7-b975-4644-8ebb-043c867aefe5 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:58.573348 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5284264e-9555-4c6a-8305-45eb1f5d70a2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 14 microversion: 2.20 time: 2.393787 Dec 15 13:04:58.573865 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6edcc6b7-b975-4644-8ebb-043c867aefe5 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:58.573991 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 80/143] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:04:56 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 14 bytes in 2396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:04:58.579671 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f62466f4-4592-431c-b4a0-125d9e646b5e tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:58.581036 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f62466f4-4592-431c-b4a0-125d9e646b5e tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:58.590933 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f62466f4-4592-431c-b4a0-125d9e646b5e tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:58.591638 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f62466f4-4592-431c-b4a0-125d9e646b5e tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:58.592533 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f62466f4-4592-431c-b4a0-125d9e646b5e tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:58.594606 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f62466f4-4592-431c-b4a0-125d9e646b5e tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:58.646381 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-6edcc6b7-b975-4644-8ebb-043c867aefe5 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:58.660208 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-6edcc6b7-b975-4644-8ebb-043c867aefe5 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f" status: 200 len: 1221 microversion: 2.1 time: 0.100166 Dec 15 13:04:58.661079 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 64/144] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:58 2021] GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f => generated 1221 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:58.741968 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f62466f4-4592-431c-b4a0-125d9e646b5e tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9417502138f842d7aab2759e0963cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aee9b9928841cfb7feb62018fc0629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:58.749827 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f62466f4-4592-431c-b4a0-125d9e646b5e tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 200 len: 1553 microversion: 2.1 time: 0.174592 Dec 15 13:04:58.750418 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 81/145] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:58 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:59.570846 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-fad182ff-f760-4a52-b8f5-331fe48f49be tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:04:59.571972 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-fad182ff-f760-4a52-b8f5-331fe48f49be tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:59.586583 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e34fe48a-4929-4540-9a0e-a023c455d067 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:04:59.587713 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e34fe48a-4929-4540-9a0e-a023c455d067 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:59.590312 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fad182ff-f760-4a52-b8f5-331fe48f49be tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:59.591024 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fad182ff-f760-4a52-b8f5-331fe48f49be tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:59.592677 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fad182ff-f760-4a52-b8f5-331fe48f49be tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:59.593740 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fad182ff-f760-4a52-b8f5-331fe48f49be tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:59.606353 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e34fe48a-4929-4540-9a0e-a023c455d067 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:59.607069 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e34fe48a-4929-4540-9a0e-a023c455d067 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:59.608078 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e34fe48a-4929-4540-9a0e-a023c455d067 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:59.608733 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e34fe48a-4929-4540-9a0e-a023c455d067 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:59.677108 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-fad182ff-f760-4a52-b8f5-331fe48f49be tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 14 microversion: 2.1 time: 0.111949 Dec 15 13:04:59.681077 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 65/146] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:04:59 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:04:59.685878 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-19915c9f-cb9e-4303-ad5b-fb9e5d2953c0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:59.686890 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-19915c9f-cb9e-4303-ad5b-fb9e5d2953c0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: 6d7e8b60-2efb-4376-ab88-65f915ebd89f] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:59.688610 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e34fe48a-4929-4540-9a0e-a023c455d067 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 14 microversion: 2.20 time: 0.107865 Dec 15 13:04:59.689596 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 82/147] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:04:59 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:59.696489 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-19915c9f-cb9e-4303-ad5b-fb9e5d2953c0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:59.696951 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-19915c9f-cb9e-4303-ad5b-fb9e5d2953c0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:59.697745 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-19915c9f-cb9e-4303-ad5b-fb9e5d2953c0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:59.698234 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-19915c9f-cb9e-4303-ad5b-fb9e5d2953c0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:59.767441 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-87b6563b-c2c7-4a0d-a250-037f30cf2775 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:59.768882 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-87b6563b-c2c7-4a0d-a250-037f30cf2775 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:59.773656 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-19915c9f-cb9e-4303-ad5b-fb9e5d2953c0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:59.776654 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-87b6563b-c2c7-4a0d-a250-037f30cf2775 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:59.777510 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-87b6563b-c2c7-4a0d-a250-037f30cf2775 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:59.778534 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-87b6563b-c2c7-4a0d-a250-037f30cf2775 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:59.779579 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-87b6563b-c2c7-4a0d-a250-037f30cf2775 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:59.784901 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-19915c9f-cb9e-4303-ad5b-fb9e5d2953c0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f" status: 200 len: 1275 microversion: 2.1 time: 0.105050 Dec 15 13:04:59.785658 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 66/148] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:59 2021] GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f => generated 1275 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:59.952937 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-87b6563b-c2c7-4a0d-a250-037f30cf2775 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9417502138f842d7aab2759e0963cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aee9b9928841cfb7feb62018fc0629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:59.961626 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-87b6563b-c2c7-4a0d-a250-037f30cf2775 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 200 len: 1553 microversion: 2.1 time: 0.198419 Dec 15 13:04:59.962261 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 83/149] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:59 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 1553 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:05:00.688510 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-1fa93329-c1e7-4310-a829-33f061200121 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:00.689433 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-1fa93329-c1e7-4310-a829-33f061200121 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:00.696956 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1fa93329-c1e7-4310-a829-33f061200121 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:00.697406 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1fa93329-c1e7-4310-a829-33f061200121 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:00.698230 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1fa93329-c1e7-4310-a829-33f061200121 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:00.698669 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1fa93329-c1e7-4310-a829-33f061200121 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:00.700482 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c0bc7e85-4216-4d7b-8352-400154aaa6bb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:00.702275 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c0bc7e85-4216-4d7b-8352-400154aaa6bb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:00.708591 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c0bc7e85-4216-4d7b-8352-400154aaa6bb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:00.709032 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c0bc7e85-4216-4d7b-8352-400154aaa6bb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:00.710111 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c0bc7e85-4216-4d7b-8352-400154aaa6bb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:00.710571 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c0bc7e85-4216-4d7b-8352-400154aaa6bb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:02.927814 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c0bc7e85-4216-4d7b-8352-400154aaa6bb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 14 microversion: 2.20 time: 2.231259 Dec 15 13:05:02.928472 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 84/150] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:05:00 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 14 bytes in 2233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:05:02.933270 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-569f1225-1201-4e9f-a556-71c92654cd73 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:02.934247 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-569f1225-1201-4e9f-a556-71c92654cd73 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: 6d7e8b60-2efb-4376-ab88-65f915ebd89f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:02.941770 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-569f1225-1201-4e9f-a556-71c92654cd73 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:02.942238 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-569f1225-1201-4e9f-a556-71c92654cd73 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:02.943019 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-569f1225-1201-4e9f-a556-71c92654cd73 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:02.943455 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-569f1225-1201-4e9f-a556-71c92654cd73 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:02.962362 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-1fa93329-c1e7-4310-a829-33f061200121 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 9604 microversion: 2.1 time: 2.277239 Dec 15 13:05:02.965847 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 67/151] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:05:00 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 9604 bytes in 2281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:02.970253 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-0f128fcc-779c-4316-9e46-93e10142d1b1 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:02.970873 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-0f128fcc-779c-4316-9e46-93e10142d1b1 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:02.977843 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0f128fcc-779c-4316-9e46-93e10142d1b1 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:02.978457 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0f128fcc-779c-4316-9e46-93e10142d1b1 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:02.979343 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0f128fcc-779c-4316-9e46-93e10142d1b1 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:02.979887 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0f128fcc-779c-4316-9e46-93e10142d1b1 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:03.133696 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-569f1225-1201-4e9f-a556-71c92654cd73 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:03.141006 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-569f1225-1201-4e9f-a556-71c92654cd73 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f" status: 200 len: 1317 microversion: 2.1 time: 0.211406 Dec 15 13:05:03.145440 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 85/152] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:02 2021] GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:03.235035 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-0f128fcc-779c-4316-9e46-93e10142d1b1 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9417502138f842d7aab2759e0963cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aee9b9928841cfb7feb62018fc0629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:03.243466 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-0f128fcc-779c-4316-9e46-93e10142d1b1 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 200 len: 1553 microversion: 2.1 time: 0.277016 Dec 15 13:05:03.244234 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 68/153] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:02 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 1553 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:03.531329 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-5333450d-94c1-4010-94f1-e6e8b6273eef req-af86c130-8fda-4164-8437-68ed5e819c72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d7e8b60-2efb-4376-ab88-65f915ebd89f", "tag": "3f816332-ae3d-4fab-880e-1af562f3a33e"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:03.532930 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:05:03.532930 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:05:03.541839 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-5333450d-94c1-4010-94f1-e6e8b6273eef req-af86c130-8fda-4164-8437-68ed5e819c72 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:03.542587 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-5333450d-94c1-4010-94f1-e6e8b6273eef req-af86c130-8fda-4164-8437-68ed5e819c72 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:03.554647 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-5333450d-94c1-4010-94f1-e6e8b6273eef req-af86c130-8fda-4164-8437-68ed5e819c72 service nova] Creating event network-changed:3f816332-ae3d-4fab-880e-1af562f3a33e for instance 6d7e8b60-2efb-4376-ab88-65f915ebd89f on hv-cinder-81322 Dec 15 13:05:03.559474 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-5333450d-94c1-4010-94f1-e6e8b6273eef req-af86c130-8fda-4164-8437-68ed5e819c72 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032113 Dec 15 13:05:03.560076 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 86/154] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:05:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:05:03.937288 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-7f97f3fe-d302-47e2-81fe-c716758515e9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:03.938233 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-7f97f3fe-d302-47e2-81fe-c716758515e9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:03.945041 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7f97f3fe-d302-47e2-81fe-c716758515e9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:03.945485 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7f97f3fe-d302-47e2-81fe-c716758515e9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:03.946368 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7f97f3fe-d302-47e2-81fe-c716758515e9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:03.946867 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7f97f3fe-d302-47e2-81fe-c716758515e9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:03.973623 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8500e803-21cc-457c-84e1-fde7851b2797 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:03.974729 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8500e803-21cc-457c-84e1-fde7851b2797 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:03.980956 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8500e803-21cc-457c-84e1-fde7851b2797 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:03.981469 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8500e803-21cc-457c-84e1-fde7851b2797 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:03.982279 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8500e803-21cc-457c-84e1-fde7851b2797 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:03.982715 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8500e803-21cc-457c-84e1-fde7851b2797 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:06.608582 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-7f97f3fe-d302-47e2-81fe-c716758515e9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 10235 microversion: 2.20 time: 2.674672 Dec 15 13:05:06.609322 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 69/155] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:05:03 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 10235 bytes in 2676 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:05:06.614138 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-0f9396a6-f09d-430a-b1b6-900edbb3bb57 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:06.616634 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-0f9396a6-f09d-430a-b1b6-900edbb3bb57 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: 6d7e8b60-2efb-4376-ab88-65f915ebd89f] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:06.624433 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0f9396a6-f09d-430a-b1b6-900edbb3bb57 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:06.624881 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0f9396a6-f09d-430a-b1b6-900edbb3bb57 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:06.625659 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0f9396a6-f09d-430a-b1b6-900edbb3bb57 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:06.626124 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0f9396a6-f09d-430a-b1b6-900edbb3bb57 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:06.641875 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8500e803-21cc-457c-84e1-fde7851b2797 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 17629 microversion: 2.1 time: 2.672550 Dec 15 13:05:06.647480 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 87/156] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:05:03 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 17629 bytes in 2679 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:05:06.652674 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c6d93e11-4eca-420a-a65c-c85c339cab96 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:06.653542 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c6d93e11-4eca-420a-a65c-c85c339cab96 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:06.661252 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c6d93e11-4eca-420a-a65c-c85c339cab96 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:06.661916 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c6d93e11-4eca-420a-a65c-c85c339cab96 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:06.662895 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c6d93e11-4eca-420a-a65c-c85c339cab96 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:06.663468 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c6d93e11-4eca-420a-a65c-c85c339cab96 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:06.872417 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c6d93e11-4eca-420a-a65c-c85c339cab96 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9417502138f842d7aab2759e0963cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aee9b9928841cfb7feb62018fc0629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:06.879356 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-0f9396a6-f09d-430a-b1b6-900edbb3bb57 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:06.886009 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c6d93e11-4eca-420a-a65c-c85c339cab96 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 200 len: 1553 microversion: 2.1 time: 0.237060 Dec 15 13:05:06.887126 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 88/157] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:06 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 1553 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:06.900868 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-0f9396a6-f09d-430a-b1b6-900edbb3bb57 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f" status: 200 len: 1317 microversion: 2.1 time: 0.290360 Dec 15 13:05:06.901984 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 70/158] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:06 2021] GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f => generated 1317 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:07.618221 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-35eed698-97be-4f46-92aa-7b1e61ad3b22 req-388ada4f-672f-4c5d-ab18-c53fb983b0c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8306f62d-ed9e-459a-b0e8-3d5c2fbffd36", "name": "network-vif-deleted", "tag": "e7607ece-d8d6-4ca2-bec8-01ff0516ff27"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:07.620105 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:05:07.620105 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:05:07.620406 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-3113a857-553e-4905-875c-07e0cb6be4a7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:07.621390 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-3113a857-553e-4905-875c-07e0cb6be4a7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:07.628357 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-35eed698-97be-4f46-92aa-7b1e61ad3b22 req-388ada4f-672f-4c5d-ab18-c53fb983b0c9 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:07.628990 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-35eed698-97be-4f46-92aa-7b1e61ad3b22 req-388ada4f-672f-4c5d-ab18-c53fb983b0c9 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:07.629935 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3113a857-553e-4905-875c-07e0cb6be4a7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:07.630530 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3113a857-553e-4905-875c-07e0cb6be4a7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:07.631317 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3113a857-553e-4905-875c-07e0cb6be4a7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:07.631763 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3113a857-553e-4905-875c-07e0cb6be4a7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:07.643000 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-35eed698-97be-4f46-92aa-7b1e61ad3b22 req-388ada4f-672f-4c5d-ab18-c53fb983b0c9 service nova] Creating event network-vif-deleted:e7607ece-d8d6-4ca2-bec8-01ff0516ff27 for instance 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 on hv-cinder-81322 Dec 15 13:05:07.649909 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-35eed698-97be-4f46-92aa-7b1e61ad3b22 req-388ada4f-672f-4c5d-ab18-c53fb983b0c9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036507 Dec 15 13:05:07.650698 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 89/159] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:05:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:05:07.655782 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5eac90a9-1f4e-4855-8118-78e9ed40b270 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:07.656769 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5eac90a9-1f4e-4855-8118-78e9ed40b270 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:07.663547 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5eac90a9-1f4e-4855-8118-78e9ed40b270 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:07.663966 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5eac90a9-1f4e-4855-8118-78e9ed40b270 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:07.664811 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5eac90a9-1f4e-4855-8118-78e9ed40b270 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:07.665253 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5eac90a9-1f4e-4855-8118-78e9ed40b270 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:10.304506 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-3113a857-553e-4905-875c-07e0cb6be4a7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 20195 microversion: 2.20 time: 2.687695 Dec 15 13:05:10.306993 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 71/160] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:05:07 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 20195 bytes in 2691 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:05:10.315852 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-595d9453-251f-4338-8457-1890432ec10f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:10.317544 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-595d9453-251f-4338-8457-1890432ec10f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:10.324984 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-595d9453-251f-4338-8457-1890432ec10f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:10.325746 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-595d9453-251f-4338-8457-1890432ec10f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:10.326709 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-595d9453-251f-4338-8457-1890432ec10f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:10.327218 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-595d9453-251f-4338-8457-1890432ec10f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:10.332703 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5eac90a9-1f4e-4855-8118-78e9ed40b270 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 23801 microversion: 2.1 time: 2.680453 Dec 15 13:05:10.335372 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 90/161] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:05:07 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 23801 bytes in 2684 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:05:10.347904 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1cfdcecf-90e3-4a55-b3e4-92b0eb0f2780 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:10.350699 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1cfdcecf-90e3-4a55-b3e4-92b0eb0f2780 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: 6d7e8b60-2efb-4376-ab88-65f915ebd89f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:10.364732 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1cfdcecf-90e3-4a55-b3e4-92b0eb0f2780 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:10.381253 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1cfdcecf-90e3-4a55-b3e4-92b0eb0f2780 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:10.382233 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1cfdcecf-90e3-4a55-b3e4-92b0eb0f2780 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:10.382733 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1cfdcecf-90e3-4a55-b3e4-92b0eb0f2780 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:10.459077 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-595d9453-251f-4338-8457-1890432ec10f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9417502138f842d7aab2759e0963cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aee9b9928841cfb7feb62018fc0629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:10.466835 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-595d9453-251f-4338-8457-1890432ec10f tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 200 len: 1345 microversion: 2.1 time: 0.157891 Dec 15 13:05:10.467403 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 72/162] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:10 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 1345 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:10.489710 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-c8c110be-3c47-450b-8335-331282d0cfbf tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-376828111", "imageRef": "67890983-693f-44ed-bdf3-22321abeab26", "flavorRef": "452", "networks": [{"uuid": "162c3d0f-e234-47fd-9154-3a362a7fadde"}]}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:10.559371 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.network.neutron [None req-c8c110be-3c47-450b-8335-331282d0cfbf tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] validate_networks() for [('162c3d0f-e234-47fd-9154-3a362a7fadde', None, None, None, None, None)] {{(pid=116097) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:05:10.624904 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1cfdcecf-90e3-4a55-b3e4-92b0eb0f2780 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:10.636573 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1cfdcecf-90e3-4a55-b3e4-92b0eb0f2780 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f" status: 200 len: 1317 microversion: 2.1 time: 0.295777 Dec 15 13:05:10.637945 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 91/163] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:10 2021] GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:11.178557 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-c8c110be-3c47-450b-8335-331282d0cfbf tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Flavor limits 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:05:11.179507 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-c8c110be-3c47-450b-8335-331282d0cfbf tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Image limits 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:05:11.180025 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-c8c110be-3c47-450b-8335-331282d0cfbf tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Flavor pref 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:05:11.180431 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-c8c110be-3c47-450b-8335-331282d0cfbf tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Image pref 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:05:11.180869 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-c8c110be-3c47-450b-8335-331282d0cfbf tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:05:11.190225 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c8c110be-3c47-450b-8335-331282d0cfbf tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:11.190679 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c8c110be-3c47-450b-8335-331282d0cfbf tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:11.191481 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c8c110be-3c47-450b-8335-331282d0cfbf tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:11.191912 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c8c110be-3c47-450b-8335-331282d0cfbf tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:11.209820 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-c8c110be-3c47-450b-8335-331282d0cfbf tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Getting quotas for project 04e0b910ad794c7db450e6bb1c96cd01. Resources: {'instances', 'cores', 'ram'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:05:11.213781 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-c8c110be-3c47-450b-8335-331282d0cfbf tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Getting quotas for user 1b47404ef24941829d657acb729f93da and project 04e0b910ad794c7db450e6bb1c96cd01. Resources: {'instances', 'cores', 'ram'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:05:11.224419 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-c8c110be-3c47-450b-8335-331282d0cfbf tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Going to run 1 instances... {{(pid=116097) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:05:11.226754 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-c8c110be-3c47-450b-8335-331282d0cfbf tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: c88af1c7-5239-4287-833a-fddf3ae94e88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67890983-693f-44ed-bdf3-22321abeab26',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:05:11.285367 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-c8c110be-3c47-450b-8335-331282d0cfbf tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.809888 Dec 15 13:05:11.286041 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 73/164] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Dec 15 13:05:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:05:11.298271 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e7efb220-06b3-4d90-9b81-c231250b0e7d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:11.299786 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e7efb220-06b3-4d90-9b81-c231250b0e7d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: c88af1c7-5239-4287-833a-fddf3ae94e88] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:11.318811 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-57f56e91-a5fe-41e2-91d6-d3b9480d48b4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:11.319905 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-57f56e91-a5fe-41e2-91d6-d3b9480d48b4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:11.332317 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-57f56e91-a5fe-41e2-91d6-d3b9480d48b4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:11.333032 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-57f56e91-a5fe-41e2-91d6-d3b9480d48b4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:11.334248 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-57f56e91-a5fe-41e2-91d6-d3b9480d48b4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:11.337880 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-57f56e91-a5fe-41e2-91d6-d3b9480d48b4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:11.375816 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e7efb220-06b3-4d90-9b81-c231250b0e7d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:11.384993 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e7efb220-06b3-4d90-9b81-c231250b0e7d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88" status: 200 len: 1217 microversion: 2.1 time: 0.090000 Dec 15 13:05:11.386403 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 92/165] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:11 2021] GET /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88 => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:11.392366 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b32c99aa-a67b-4c48-b9c2-e460cad4f42e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:11.393878 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b32c99aa-a67b-4c48-b9c2-e460cad4f42e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:11.404383 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b32c99aa-a67b-4c48-b9c2-e460cad4f42e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:11.405169 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b32c99aa-a67b-4c48-b9c2-e460cad4f42e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:11.406035 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b32c99aa-a67b-4c48-b9c2-e460cad4f42e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:11.406601 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b32c99aa-a67b-4c48-b9c2-e460cad4f42e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:11.435197 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-57f56e91-a5fe-41e2-91d6-d3b9480d48b4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 21954 microversion: 2.20 time: 0.121161 Dec 15 13:05:11.435844 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 74/166] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:05:11 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 21954 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:05:11.485606 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-c9e0148a-4e19-49ff-87ba-b637f87f2ea2 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:11.487106 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-c9e0148a-4e19-49ff-87ba-b637f87f2ea2 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:11.497451 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b32c99aa-a67b-4c48-b9c2-e460cad4f42e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 24402 microversion: 2.1 time: 0.109493 Dec 15 13:05:11.498188 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 93/167] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:05:11 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 24402 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:05:11.504388 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c9e0148a-4e19-49ff-87ba-b637f87f2ea2 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:11.505142 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c9e0148a-4e19-49ff-87ba-b637f87f2ea2 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:11.506168 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c9e0148a-4e19-49ff-87ba-b637f87f2ea2 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:11.506806 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c9e0148a-4e19-49ff-87ba-b637f87f2ea2 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:11.550271 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c9e0148a-4e19-49ff-87ba-b637f87f2ea2 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:11.551095 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c9e0148a-4e19-49ff-87ba-b637f87f2ea2 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:11.551850 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.objects.instance [None req-c9e0148a-4e19-49ff-87ba-b637f87f2ea2 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lazy-loading 'fault' on Instance uuid 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 {{(pid=116097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:05:11.613612 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-c9e0148a-4e19-49ff-87ba-b637f87f2ea2 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9417502138f842d7aab2759e0963cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aee9b9928841cfb7feb62018fc0629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:11.622916 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-c9e0148a-4e19-49ff-87ba-b637f87f2ea2 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 200 len: 1304 microversion: 2.1 time: 0.142872 Dec 15 13:05:11.624068 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 75/168] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:11 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 1304 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:11.665712 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8266f752-9a72-4211-8ba6-e2f7cd989071 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:11.666899 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8266f752-9a72-4211-8ba6-e2f7cd989071 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: 6d7e8b60-2efb-4376-ab88-65f915ebd89f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:11.683346 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8266f752-9a72-4211-8ba6-e2f7cd989071 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:11.683934 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8266f752-9a72-4211-8ba6-e2f7cd989071 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:11.685133 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8266f752-9a72-4211-8ba6-e2f7cd989071 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:11.685657 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8266f752-9a72-4211-8ba6-e2f7cd989071 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:11.844476 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8266f752-9a72-4211-8ba6-e2f7cd989071 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:11.853685 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8266f752-9a72-4211-8ba6-e2f7cd989071 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f" status: 200 len: 1317 microversion: 2.1 time: 0.201831 Dec 15 13:05:11.863739 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 94/169] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:11 2021] GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f => generated 1317 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:12.403253 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-440348bf-6802-4c5b-8b98-6f4bf5ccbb2e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:12.404386 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-440348bf-6802-4c5b-8b98-6f4bf5ccbb2e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: c88af1c7-5239-4287-833a-fddf3ae94e88] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:12.413488 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-440348bf-6802-4c5b-8b98-6f4bf5ccbb2e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:12.413936 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-440348bf-6802-4c5b-8b98-6f4bf5ccbb2e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:12.414737 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-440348bf-6802-4c5b-8b98-6f4bf5ccbb2e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:12.415339 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-440348bf-6802-4c5b-8b98-6f4bf5ccbb2e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:12.447537 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c4e73b3b-9e6f-48d4-94c9-25d765726cb9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:12.449336 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c4e73b3b-9e6f-48d4-94c9-25d765726cb9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:12.457864 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c4e73b3b-9e6f-48d4-94c9-25d765726cb9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:12.458548 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c4e73b3b-9e6f-48d4-94c9-25d765726cb9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:12.459514 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c4e73b3b-9e6f-48d4-94c9-25d765726cb9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:12.460011 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c4e73b3b-9e6f-48d4-94c9-25d765726cb9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:12.494896 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-440348bf-6802-4c5b-8b98-6f4bf5ccbb2e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:12.503486 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-440348bf-6802-4c5b-8b98-6f4bf5ccbb2e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88" status: 200 len: 1269 microversion: 2.1 time: 0.104429 Dec 15 13:05:12.504082 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 76/170] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:12 2021] GET /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88 => generated 1269 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:12.513457 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-4eca7e73-91e9-4d7c-aa3f-60d8df077afa tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:12.514651 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-4eca7e73-91e9-4d7c-aa3f-60d8df077afa tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:12.521907 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4eca7e73-91e9-4d7c-aa3f-60d8df077afa tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:12.522689 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4eca7e73-91e9-4d7c-aa3f-60d8df077afa tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:12.523782 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4eca7e73-91e9-4d7c-aa3f-60d8df077afa tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:12.524405 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4eca7e73-91e9-4d7c-aa3f-60d8df077afa tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:12.545678 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c4e73b3b-9e6f-48d4-94c9-25d765726cb9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 23216 microversion: 2.20 time: 0.102253 Dec 15 13:05:12.546699 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 95/171] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:05:12 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 23216 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:05:12.616171 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-4eca7e73-91e9-4d7c-aa3f-60d8df077afa tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 25493 microversion: 2.1 time: 0.105981 Dec 15 13:05:12.616853 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 77/172] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:05:12 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 25493 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:05:12.644461 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-bbdd2a12-bd6d-43ad-9526-1461d2a3028c tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:12.646054 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-bbdd2a12-bd6d-43ad-9526-1461d2a3028c tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:12.654982 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bbdd2a12-bd6d-43ad-9526-1461d2a3028c tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:12.655657 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bbdd2a12-bd6d-43ad-9526-1461d2a3028c tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:12.657661 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bbdd2a12-bd6d-43ad-9526-1461d2a3028c tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:12.658549 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bbdd2a12-bd6d-43ad-9526-1461d2a3028c tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:12.677198 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-bbdd2a12-bd6d-43ad-9526-1461d2a3028c tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] HTTP exception thrown: Instance 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 could not be found. Dec 15 13:05:12.677826 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-bbdd2a12-bd6d-43ad-9526-1461d2a3028c tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Returning 404 to user: Instance 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:05:12.678911 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-bbdd2a12-bd6d-43ad-9526-1461d2a3028c tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 404 len: 111 microversion: 2.1 time: 0.041833 Dec 15 13:05:12.679686 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 96/173] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:12 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:05:12.812371 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-d1f0a2a7-210f-4950-b7a7-d4c247c9c1bb tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:12.814749 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-d1f0a2a7-210f-4950-b7a7-d4c247c9c1bb tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:12.823800 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d1f0a2a7-210f-4950-b7a7-d4c247c9c1bb tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:12.824530 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d1f0a2a7-210f-4950-b7a7-d4c247c9c1bb tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:12.825407 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d1f0a2a7-210f-4950-b7a7-d4c247c9c1bb tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:12.825928 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d1f0a2a7-210f-4950-b7a7-d4c247c9c1bb tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:12.841747 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.wsgi [None req-d1f0a2a7-210f-4950-b7a7-d4c247c9c1bb tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] HTTP exception thrown: Instance 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 could not be found. Dec 15 13:05:12.842460 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-d1f0a2a7-210f-4950-b7a7-d4c247c9c1bb tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Returning 404 to user: Instance 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 could not be found. {{(pid=116097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:05:12.843361 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-d1f0a2a7-210f-4950-b7a7-d4c247c9c1bb tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036028 Dec 15 13:05:12.843978 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 78/174] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:05:12 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:05:12.872716 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f2d878ec-e714-4482-88e7-3442a5709683 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:12.873670 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f2d878ec-e714-4482-88e7-3442a5709683 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: 6d7e8b60-2efb-4376-ab88-65f915ebd89f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:12.881555 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f2d878ec-e714-4482-88e7-3442a5709683 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:12.882323 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f2d878ec-e714-4482-88e7-3442a5709683 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:12.883397 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f2d878ec-e714-4482-88e7-3442a5709683 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:12.884087 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f2d878ec-e714-4482-88e7-3442a5709683 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:13.034782 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f2d878ec-e714-4482-88e7-3442a5709683 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:13.042402 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f2d878ec-e714-4482-88e7-3442a5709683 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f" status: 200 len: 1317 microversion: 2.1 time: 0.174786 Dec 15 13:05:13.043135 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 97/175] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:12 2021] GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:05:13.521667 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-f3877102-94ac-499b-923c-944c090f2a9b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:13.522404 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-f3877102-94ac-499b-923c-944c090f2a9b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: c88af1c7-5239-4287-833a-fddf3ae94e88] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:13.529114 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f3877102-94ac-499b-923c-944c090f2a9b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:13.529764 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f3877102-94ac-499b-923c-944c090f2a9b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:13.530598 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f3877102-94ac-499b-923c-944c090f2a9b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:13.531037 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f3877102-94ac-499b-923c-944c090f2a9b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:13.557612 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-325367cb-6203-4a99-b921-b18591381cce tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:13.559596 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-325367cb-6203-4a99-b921-b18591381cce tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:13.567278 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-325367cb-6203-4a99-b921-b18591381cce tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:13.567788 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-325367cb-6203-4a99-b921-b18591381cce tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:13.568642 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-325367cb-6203-4a99-b921-b18591381cce tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:13.569275 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-325367cb-6203-4a99-b921-b18591381cce tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:13.654923 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-325367cb-6203-4a99-b921-b18591381cce tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 24331 microversion: 2.20 time: 0.101158 Dec 15 13:05:13.660094 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 98/176] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:05:13 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 24331 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:05:13.665573 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-33631543-9463-48ec-9b9f-a7e72f3a2440 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:13.666917 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-33631543-9463-48ec-9b9f-a7e72f3a2440 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:13.689165 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-33631543-9463-48ec-9b9f-a7e72f3a2440 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:13.689923 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-33631543-9463-48ec-9b9f-a7e72f3a2440 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:13.691324 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-33631543-9463-48ec-9b9f-a7e72f3a2440 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:13.692049 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-33631543-9463-48ec-9b9f-a7e72f3a2440 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:13.775947 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-33631543-9463-48ec-9b9f-a7e72f3a2440 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 26330 microversion: 2.1 time: 0.114091 Dec 15 13:05:13.777184 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 99/177] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:05:13 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 26330 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:05:13.818182 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-f3877102-94ac-499b-923c-944c090f2a9b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:13.827555 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-f3877102-94ac-499b-923c-944c090f2a9b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88" status: 200 len: 1317 microversion: 2.1 time: 0.310258 Dec 15 13:05:13.834791 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 79/178] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:13 2021] GET /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88 => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:13.976549 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-3cee0d2b-6144-4296-a1e2-84ec1c16e661 req-12a402e7-fc4d-491b-acd2-f7cf4058b49c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c88af1c7-5239-4287-833a-fddf3ae94e88", "tag": "47ca2e9d-4ba0-47a6-a133-ed51c6693aa3"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:13.981743 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:05:13.981743 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:05:13.991363 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-3cee0d2b-6144-4296-a1e2-84ec1c16e661 req-12a402e7-fc4d-491b-acd2-f7cf4058b49c service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:13.992144 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-3cee0d2b-6144-4296-a1e2-84ec1c16e661 req-12a402e7-fc4d-491b-acd2-f7cf4058b49c service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:14.007446 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-3cee0d2b-6144-4296-a1e2-84ec1c16e661 req-12a402e7-fc4d-491b-acd2-f7cf4058b49c service nova] Creating event network-changed:47ca2e9d-4ba0-47a6-a133-ed51c6693aa3 for instance c88af1c7-5239-4287-833a-fddf3ae94e88 on hv-cinder-81322 Dec 15 13:05:14.014028 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-3cee0d2b-6144-4296-a1e2-84ec1c16e661 req-12a402e7-fc4d-491b-acd2-f7cf4058b49c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046356 Dec 15 13:05:14.014903 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 100/179] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:05:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:05:14.044531 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-5fbb60c0-dd64-4f0d-9301-e35ed888d970 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:14.045267 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-5fbb60c0-dd64-4f0d-9301-e35ed888d970 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:14.052659 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5fbb60c0-dd64-4f0d-9301-e35ed888d970 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:14.053170 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5fbb60c0-dd64-4f0d-9301-e35ed888d970 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:14.054015 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5fbb60c0-dd64-4f0d-9301-e35ed888d970 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:14.054539 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5fbb60c0-dd64-4f0d-9301-e35ed888d970 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:14.060452 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4a821f25-788f-4b85-bfbd-c5d4055023f2 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:14.061709 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4a821f25-788f-4b85-bfbd-c5d4055023f2 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: 6d7e8b60-2efb-4376-ab88-65f915ebd89f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:14.068296 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4a821f25-788f-4b85-bfbd-c5d4055023f2 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:14.068884 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4a821f25-788f-4b85-bfbd-c5d4055023f2 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:14.069768 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4a821f25-788f-4b85-bfbd-c5d4055023f2 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:14.070301 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4a821f25-788f-4b85-bfbd-c5d4055023f2 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:14.071630 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.wsgi [None req-5fbb60c0-dd64-4f0d-9301-e35ed888d970 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] HTTP exception thrown: Instance 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 could not be found. Dec 15 13:05:14.072289 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-5fbb60c0-dd64-4f0d-9301-e35ed888d970 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Returning 404 to user: Instance 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 could not be found. {{(pid=116097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:05:14.073496 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-5fbb60c0-dd64-4f0d-9301-e35ed888d970 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 404 len: 111 microversion: 2.1 time: 0.032377 Dec 15 13:05:14.076244 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 80/180] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Dec 15 13:05:14 2021] DELETE /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:05:14.083636 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-63ed793a-6e49-4b1a-badd-5e28b2823884 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:14.084470 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-63ed793a-6e49-4b1a-badd-5e28b2823884 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] [instance: 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:14.091290 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-63ed793a-6e49-4b1a-badd-5e28b2823884 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:14.091808 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-63ed793a-6e49-4b1a-badd-5e28b2823884 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:14.092804 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-63ed793a-6e49-4b1a-badd-5e28b2823884 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:14.093311 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-63ed793a-6e49-4b1a-badd-5e28b2823884 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:14.108377 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.wsgi [None req-63ed793a-6e49-4b1a-badd-5e28b2823884 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] HTTP exception thrown: Instance 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 could not be found. Dec 15 13:05:14.109093 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-63ed793a-6e49-4b1a-badd-5e28b2823884 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] Returning 404 to user: Instance 8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 could not be found. {{(pid=116097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:05:14.110005 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-63ed793a-6e49-4b1a-badd-5e28b2823884 tempest-DeleteServersTestJSON-1273721563 tempest-DeleteServersTestJSON-1273721563-project] 10.222.0.57 "GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36" status: 404 len: 111 microversion: 2.1 time: 0.031269 Dec 15 13:05:14.113428 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 81/181] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:14 2021] GET /compute/v2.1/servers/8306f62d-ed9e-459a-b0e8-3d5c2fbffd36 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:05:14.305329 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4a821f25-788f-4b85-bfbd-c5d4055023f2 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:14.314625 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4a821f25-788f-4b85-bfbd-c5d4055023f2 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f" status: 200 len: 1317 microversion: 2.1 time: 0.257811 Dec 15 13:05:14.315457 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 101/182] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:14 2021] GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:14.667226 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-94e272ff-209f-4b2b-9379-1bbdc9f549b9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:14.668148 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-94e272ff-209f-4b2b-9379-1bbdc9f549b9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:14.674894 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-94e272ff-209f-4b2b-9379-1bbdc9f549b9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:14.675337 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-94e272ff-209f-4b2b-9379-1bbdc9f549b9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:14.676115 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-94e272ff-209f-4b2b-9379-1bbdc9f549b9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:14.676554 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-94e272ff-209f-4b2b-9379-1bbdc9f549b9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:14.787949 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-82202cea-0152-4c7e-aa64-dfe3b5c6675a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:14.789541 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-82202cea-0152-4c7e-aa64-dfe3b5c6675a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:14.805824 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-82202cea-0152-4c7e-aa64-dfe3b5c6675a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:14.806436 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-82202cea-0152-4c7e-aa64-dfe3b5c6675a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:14.807708 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-82202cea-0152-4c7e-aa64-dfe3b5c6675a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:14.808352 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-82202cea-0152-4c7e-aa64-dfe3b5c6675a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:17.062766 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-82202cea-0152-4c7e-aa64-dfe3b5c6675a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 27727 microversion: 2.1 time: 2.278393 Dec 15 13:05:17.070655 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 102/183] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:05:14 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 27727 bytes in 2288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:05:17.076432 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-94e272ff-209f-4b2b-9379-1bbdc9f549b9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 27187 microversion: 2.20 time: 2.412687 Dec 15 13:05:17.077808 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 82/184] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:05:14 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 27187 bytes in 2415 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:05:17.084389 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-70b04c09-1485-4939-bc7f-1ea6fad38446 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:17.091749 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-70b04c09-1485-4939-bc7f-1ea6fad38446 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: 6d7e8b60-2efb-4376-ab88-65f915ebd89f] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:17.094510 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d27385ef-0a70-46ca-9f23-b508524939ba tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:17.095350 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d27385ef-0a70-46ca-9f23-b508524939ba tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: c88af1c7-5239-4287-833a-fddf3ae94e88] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:17.106282 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-70b04c09-1485-4939-bc7f-1ea6fad38446 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:17.107065 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-70b04c09-1485-4939-bc7f-1ea6fad38446 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:17.110328 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-70b04c09-1485-4939-bc7f-1ea6fad38446 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:17.111572 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-70b04c09-1485-4939-bc7f-1ea6fad38446 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:17.112220 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d27385ef-0a70-46ca-9f23-b508524939ba tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:17.115081 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d27385ef-0a70-46ca-9f23-b508524939ba tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:17.121208 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d27385ef-0a70-46ca-9f23-b508524939ba tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:17.123602 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d27385ef-0a70-46ca-9f23-b508524939ba tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:17.352794 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d27385ef-0a70-46ca-9f23-b508524939ba tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:17.375013 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d27385ef-0a70-46ca-9f23-b508524939ba tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88" status: 200 len: 1317 microversion: 2.1 time: 0.302350 Dec 15 13:05:17.384755 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 103/185] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:17 2021] GET /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88 => generated 1317 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:17.483312 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-70b04c09-1485-4939-bc7f-1ea6fad38446 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:17.493204 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-70b04c09-1485-4939-bc7f-1ea6fad38446 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f" status: 200 len: 1317 microversion: 2.1 time: 0.413436 Dec 15 13:05:17.495399 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 83/186] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:17 2021] GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f => generated 1317 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:18.076645 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a8d37887-2040-4363-914c-e772e43c6fbf tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:18.077760 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a8d37887-2040-4363-914c-e772e43c6fbf tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:18.086689 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a8d37887-2040-4363-914c-e772e43c6fbf tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:18.087367 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a8d37887-2040-4363-914c-e772e43c6fbf tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:18.088323 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a8d37887-2040-4363-914c-e772e43c6fbf tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:18.088926 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a8d37887-2040-4363-914c-e772e43c6fbf tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:18.089306 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-d09b9c12-da83-4cb2-bcde-ef184776b584 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:18.090430 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-d09b9c12-da83-4cb2-bcde-ef184776b584 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:18.100779 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d09b9c12-da83-4cb2-bcde-ef184776b584 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:18.101514 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d09b9c12-da83-4cb2-bcde-ef184776b584 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:18.102510 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d09b9c12-da83-4cb2-bcde-ef184776b584 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:18.103112 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d09b9c12-da83-4cb2-bcde-ef184776b584 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:18.208616 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a8d37887-2040-4363-914c-e772e43c6fbf tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 28110 microversion: 2.1 time: 0.134175 Dec 15 13:05:18.210836 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 104/187] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:05:18 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 28110 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:05:18.226823 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-d09b9c12-da83-4cb2-bcde-ef184776b584 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 27489 microversion: 2.20 time: 0.141536 Dec 15 13:05:18.227466 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 84/188] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:05:18 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 27489 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:05:18.399300 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-fc776d50-4119-4464-8e04-7703fe43174b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:18.400015 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-fc776d50-4119-4464-8e04-7703fe43174b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: c88af1c7-5239-4287-833a-fddf3ae94e88] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:18.427209 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fc776d50-4119-4464-8e04-7703fe43174b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:18.428604 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fc776d50-4119-4464-8e04-7703fe43174b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:18.430413 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fc776d50-4119-4464-8e04-7703fe43174b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:18.433283 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fc776d50-4119-4464-8e04-7703fe43174b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:18.513482 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-5545d039-7383-43b2-a79f-79e1d70c66b3 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:18.515376 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-5545d039-7383-43b2-a79f-79e1d70c66b3 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: 6d7e8b60-2efb-4376-ab88-65f915ebd89f] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:18.533626 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5545d039-7383-43b2-a79f-79e1d70c66b3 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:18.534268 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5545d039-7383-43b2-a79f-79e1d70c66b3 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:18.536333 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5545d039-7383-43b2-a79f-79e1d70c66b3 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:18.536835 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5545d039-7383-43b2-a79f-79e1d70c66b3 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:18.716127 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-5545d039-7383-43b2-a79f-79e1d70c66b3 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:18.724525 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-5545d039-7383-43b2-a79f-79e1d70c66b3 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f" status: 200 len: 1317 microversion: 2.1 time: 0.215877 Dec 15 13:05:18.725300 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 85/189] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:18 2021] GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:05:18.816395 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-fc776d50-4119-4464-8e04-7703fe43174b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:18.824106 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-fc776d50-4119-4464-8e04-7703fe43174b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88" status: 200 len: 1317 microversion: 2.1 time: 0.435405 Dec 15 13:05:18.824677 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 105/190] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:18 2021] GET /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88 => generated 1317 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:19.224083 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-dc4f41fd-d970-406d-bef6-74656bd8b3dd tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:19.226645 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-dc4f41fd-d970-406d-bef6-74656bd8b3dd tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:19.239156 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-26d62420-9d06-4f40-8c30-1dd227053aa6 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:19.241841 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-26d62420-9d06-4f40-8c30-1dd227053aa6 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:19.263775 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-26d62420-9d06-4f40-8c30-1dd227053aa6 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:19.267593 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dc4f41fd-d970-406d-bef6-74656bd8b3dd tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:19.268724 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-26d62420-9d06-4f40-8c30-1dd227053aa6 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:19.270072 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-26d62420-9d06-4f40-8c30-1dd227053aa6 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:19.271100 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dc4f41fd-d970-406d-bef6-74656bd8b3dd tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:19.271721 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-26d62420-9d06-4f40-8c30-1dd227053aa6 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:19.272725 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dc4f41fd-d970-406d-bef6-74656bd8b3dd tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:19.274984 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dc4f41fd-d970-406d-bef6-74656bd8b3dd tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:19.410613 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-26d62420-9d06-4f40-8c30-1dd227053aa6 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 27771 microversion: 2.20 time: 0.175359 Dec 15 13:05:19.412112 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 106/191] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:05:19 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 27771 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:05:19.430365 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-dc4f41fd-d970-406d-bef6-74656bd8b3dd tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 28154 microversion: 2.1 time: 0.212411 Dec 15 13:05:19.431480 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 86/192] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:05:19 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 28154 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:05:19.456891 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-6454a68c-d8c4-43f0-a20d-3b5bf42442b6 req-ac9b29a1-d1de-4066-957b-87ddbe3e9f0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d7e8b60-2efb-4376-ab88-65f915ebd89f", "name": "network-vif-plugged", "status": "completed", "tag": "3f816332-ae3d-4fab-880e-1af562f3a33e"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:19.458362 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:05:19.458362 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:05:19.469541 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-6454a68c-d8c4-43f0-a20d-3b5bf42442b6 req-ac9b29a1-d1de-4066-957b-87ddbe3e9f0b service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:19.470029 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-6454a68c-d8c4-43f0-a20d-3b5bf42442b6 req-ac9b29a1-d1de-4066-957b-87ddbe3e9f0b service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:19.504483 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-6454a68c-d8c4-43f0-a20d-3b5bf42442b6 req-ac9b29a1-d1de-4066-957b-87ddbe3e9f0b service nova] Creating event network-vif-plugged:3f816332-ae3d-4fab-880e-1af562f3a33e for instance 6d7e8b60-2efb-4376-ab88-65f915ebd89f on hv-cinder-81322 Dec 15 13:05:19.520126 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-6454a68c-d8c4-43f0-a20d-3b5bf42442b6 req-ac9b29a1-d1de-4066-957b-87ddbe3e9f0b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068003 Dec 15 13:05:19.521150 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 107/193] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:05:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:05:19.741941 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-ddaa4812-e217-41bd-b244-343be85bd438 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:19.742916 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-ddaa4812-e217-41bd-b244-343be85bd438 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: 6d7e8b60-2efb-4376-ab88-65f915ebd89f] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:19.757382 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ddaa4812-e217-41bd-b244-343be85bd438 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:19.758663 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ddaa4812-e217-41bd-b244-343be85bd438 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:19.760773 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ddaa4812-e217-41bd-b244-343be85bd438 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:19.761813 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ddaa4812-e217-41bd-b244-343be85bd438 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:19.841936 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-085ac2e6-3552-41f4-9423-64b59b9d8d1b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:19.843254 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-085ac2e6-3552-41f4-9423-64b59b9d8d1b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: c88af1c7-5239-4287-833a-fddf3ae94e88] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:19.859316 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-085ac2e6-3552-41f4-9423-64b59b9d8d1b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:19.861680 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-085ac2e6-3552-41f4-9423-64b59b9d8d1b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:19.862768 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-085ac2e6-3552-41f4-9423-64b59b9d8d1b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:19.863429 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-085ac2e6-3552-41f4-9423-64b59b9d8d1b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:20.113019 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-ddaa4812-e217-41bd-b244-343be85bd438 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:20.130297 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-ddaa4812-e217-41bd-b244-343be85bd438 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f" status: 200 len: 1317 microversion: 2.1 time: 0.392359 Dec 15 13:05:20.143657 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 87/194] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:19 2021] GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f => generated 1317 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:20.338100 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-085ac2e6-3552-41f4-9423-64b59b9d8d1b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:20.354111 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-085ac2e6-3552-41f4-9423-64b59b9d8d1b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88" status: 200 len: 1317 microversion: 2.1 time: 0.515338 Dec 15 13:05:20.356115 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 108/195] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:19 2021] GET /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88 => generated 1317 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:05:20.423231 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-566de2f6-7eab-43b9-883f-4919967962f4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:20.424244 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-566de2f6-7eab-43b9-883f-4919967962f4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:20.440810 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-566de2f6-7eab-43b9-883f-4919967962f4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:20.441676 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-566de2f6-7eab-43b9-883f-4919967962f4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:20.443307 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-566de2f6-7eab-43b9-883f-4919967962f4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:20.443981 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-566de2f6-7eab-43b9-883f-4919967962f4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:20.444155 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-81a5e680-c1bc-489c-897b-ef99db027f8f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:20.445307 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-81a5e680-c1bc-489c-897b-ef99db027f8f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:20.456224 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-81a5e680-c1bc-489c-897b-ef99db027f8f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:20.456962 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-81a5e680-c1bc-489c-897b-ef99db027f8f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:20.458225 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-81a5e680-c1bc-489c-897b-ef99db027f8f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:20.463221 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-81a5e680-c1bc-489c-897b-ef99db027f8f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:20.571913 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-566de2f6-7eab-43b9-883f-4919967962f4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 28191 microversion: 2.20 time: 0.150992 Dec 15 13:05:20.576202 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 88/196] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:05:20 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 28191 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:05:20.592985 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-81a5e680-c1bc-489c-897b-ef99db027f8f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 28281 microversion: 2.1 time: 0.152052 Dec 15 13:05:20.594444 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 109/197] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:05:20 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 28281 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:05:21.157876 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-5bdceabd-154e-4886-85a1-8315378935e7 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:21.158896 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-5bdceabd-154e-4886-85a1-8315378935e7 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: 6d7e8b60-2efb-4376-ab88-65f915ebd89f] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:21.178584 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5bdceabd-154e-4886-85a1-8315378935e7 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:21.181046 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5bdceabd-154e-4886-85a1-8315378935e7 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:21.181866 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5bdceabd-154e-4886-85a1-8315378935e7 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:21.182344 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5bdceabd-154e-4886-85a1-8315378935e7 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:21.372558 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-60c598bd-2275-4ae3-b48d-607ea8c50980 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:21.373267 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-60c598bd-2275-4ae3-b48d-607ea8c50980 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: c88af1c7-5239-4287-833a-fddf3ae94e88] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:21.382281 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-60c598bd-2275-4ae3-b48d-607ea8c50980 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:21.395164 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-60c598bd-2275-4ae3-b48d-607ea8c50980 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:21.405967 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-60c598bd-2275-4ae3-b48d-607ea8c50980 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:21.406928 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-60c598bd-2275-4ae3-b48d-607ea8c50980 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:21.849097 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-5bdceabd-154e-4886-85a1-8315378935e7 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:21.856582 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-5bdceabd-154e-4886-85a1-8315378935e7 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f" status: 200 len: 1317 microversion: 2.1 time: 0.710985 Dec 15 13:05:21.863904 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 89/198] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:21 2021] GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f => generated 1317 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:21.872802 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-8df89514-091e-45f4-b740-9fe9fcea6f3b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:21.882652 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-60c598bd-2275-4ae3-b48d-607ea8c50980 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:21.885422 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-8df89514-091e-45f4-b740-9fe9fcea6f3b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:21.890951 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-60c598bd-2275-4ae3-b48d-607ea8c50980 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88" status: 200 len: 1317 microversion: 2.1 time: 0.523463 Dec 15 13:05:21.891828 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 110/199] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:21 2021] GET /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88 => generated 1317 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:05:21.898291 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d9f82b28-434b-487f-9d5b-dee11d14d994 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:21.899727 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d9f82b28-434b-487f-9d5b-dee11d14d994 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:21.906783 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d9f82b28-434b-487f-9d5b-dee11d14d994 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:21.907765 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d9f82b28-434b-487f-9d5b-dee11d14d994 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:21.908542 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8df89514-091e-45f4-b740-9fe9fcea6f3b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:21.908671 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d9f82b28-434b-487f-9d5b-dee11d14d994 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:21.908989 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d9f82b28-434b-487f-9d5b-dee11d14d994 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:21.909095 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8df89514-091e-45f4-b740-9fe9fcea6f3b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:21.912001 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8df89514-091e-45f4-b740-9fe9fcea6f3b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:21.913093 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8df89514-091e-45f4-b740-9fe9fcea6f3b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:22.039127 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-8df89514-091e-45f4-b740-9fe9fcea6f3b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 28193 microversion: 2.20 time: 0.173445 Dec 15 13:05:22.044784 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 90/200] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:05:21 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 28193 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:05:22.049058 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-a184ff2d-19ac-4453-95eb-faf51a2a4ecc req-f08b643d-63ba-45f0-9e82-6756c9d2d4e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c88af1c7-5239-4287-833a-fddf3ae94e88", "name": "network-vif-plugged", "status": "completed", "tag": "47ca2e9d-4ba0-47a6-a133-ed51c6693aa3"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:22.055777 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:05:22.055777 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:05:22.076633 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d9f82b28-434b-487f-9d5b-dee11d14d994 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 28443 microversion: 2.1 time: 0.183343 Dec 15 13:05:22.077308 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 111/201] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:05:21 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 28443 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:05:22.087792 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-a184ff2d-19ac-4453-95eb-faf51a2a4ecc req-f08b643d-63ba-45f0-9e82-6756c9d2d4e3 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:22.088395 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-a184ff2d-19ac-4453-95eb-faf51a2a4ecc req-f08b643d-63ba-45f0-9e82-6756c9d2d4e3 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:22.109796 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-a184ff2d-19ac-4453-95eb-faf51a2a4ecc req-f08b643d-63ba-45f0-9e82-6756c9d2d4e3 service nova] Creating event network-vif-plugged:47ca2e9d-4ba0-47a6-a133-ed51c6693aa3 for instance c88af1c7-5239-4287-833a-fddf3ae94e88 on hv-cinder-81322 Dec 15 13:05:22.115663 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-a184ff2d-19ac-4453-95eb-faf51a2a4ecc req-f08b643d-63ba-45f0-9e82-6756c9d2d4e3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074076 Dec 15 13:05:22.116266 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 91/202] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:05:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:05:22.885596 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a1608af5-d25d-4f50-9e2a-91b70e144c80 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:22.886872 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a1608af5-d25d-4f50-9e2a-91b70e144c80 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: 6d7e8b60-2efb-4376-ab88-65f915ebd89f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:22.902294 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a1608af5-d25d-4f50-9e2a-91b70e144c80 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:22.904050 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a1608af5-d25d-4f50-9e2a-91b70e144c80 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:22.906838 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a1608af5-d25d-4f50-9e2a-91b70e144c80 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:22.908793 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a1608af5-d25d-4f50-9e2a-91b70e144c80 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:22.911192 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-7ebd3106-516d-418d-bffd-55c4e6ac7bde tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:22.911886 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-7ebd3106-516d-418d-bffd-55c4e6ac7bde tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: c88af1c7-5239-4287-833a-fddf3ae94e88] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:22.934235 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7ebd3106-516d-418d-bffd-55c4e6ac7bde tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:22.934697 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7ebd3106-516d-418d-bffd-55c4e6ac7bde tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:22.935496 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7ebd3106-516d-418d-bffd-55c4e6ac7bde tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:22.935935 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7ebd3106-516d-418d-bffd-55c4e6ac7bde tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:23.149339 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a1608af5-d25d-4f50-9e2a-91b70e144c80 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:23.162226 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a1608af5-d25d-4f50-9e2a-91b70e144c80 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f" status: 200 len: 1505 microversion: 2.1 time: 0.282275 Dec 15 13:05:23.176966 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 112/203] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:22 2021] GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f => generated 1505 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:23.191510 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1d5f3cbc-3bac-4cb8-8545-ae2276868d31 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:23.194986 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1d5f3cbc-3bac-4cb8-8545-ae2276868d31 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:23.203102 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1d5f3cbc-3bac-4cb8-8545-ae2276868d31 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:23.204503 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1d5f3cbc-3bac-4cb8-8545-ae2276868d31 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:23.213764 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1d5f3cbc-3bac-4cb8-8545-ae2276868d31 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:23.214595 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1d5f3cbc-3bac-4cb8-8545-ae2276868d31 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:23.364540 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1d5f3cbc-3bac-4cb8-8545-ae2276868d31 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 28320 microversion: 2.20 time: 0.182135 Dec 15 13:05:23.370896 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 113/204] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:05:23 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 28320 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:05:23.383127 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5c5c5db6-d875-4def-ab3b-4f309a2bcb3e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:23.384452 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5c5c5db6-d875-4def-ab3b-4f309a2bcb3e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:23.398003 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5c5c5db6-d875-4def-ab3b-4f309a2bcb3e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:23.398492 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5c5c5db6-d875-4def-ab3b-4f309a2bcb3e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:23.399336 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5c5c5db6-d875-4def-ab3b-4f309a2bcb3e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:23.399708 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5c5c5db6-d875-4def-ab3b-4f309a2bcb3e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:23.408542 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-7ebd3106-516d-418d-bffd-55c4e6ac7bde tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:23.421383 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-7ebd3106-516d-418d-bffd-55c4e6ac7bde tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88" status: 200 len: 1317 microversion: 2.1 time: 0.515347 Dec 15 13:05:23.421958 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 92/205] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:22 2021] GET /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88 => generated 1317 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:05:23.581226 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5c5c5db6-d875-4def-ab3b-4f309a2bcb3e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 28610 microversion: 2.1 time: 0.207011 Dec 15 13:05:23.585303 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 114/206] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:05:23 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 28610 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:05:23.934267 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-0c752f97-7062-444b-b5bb-693068119314 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-39858966", "imageRef": "67890983-693f-44ed-bdf3-22321abeab26", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9f17b8fd-07d6-4b12-8085-ba9909eaa2da"}]}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:24.064484 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.network.neutron [None req-0c752f97-7062-444b-b5bb-693068119314 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] validate_networks() for [('9f17b8fd-07d6-4b12-8085-ba9909eaa2da', None, None, None, None, None)] {{(pid=116097) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:05:24.380724 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-709d10db-d65e-42a3-918d-b31233f7ec7c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:24.382635 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-709d10db-d65e-42a3-918d-b31233f7ec7c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:24.410719 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-709d10db-d65e-42a3-918d-b31233f7ec7c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:24.411030 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-709d10db-d65e-42a3-918d-b31233f7ec7c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:24.411983 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-709d10db-d65e-42a3-918d-b31233f7ec7c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:24.412609 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-709d10db-d65e-42a3-918d-b31233f7ec7c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:24.551137 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-709d10db-d65e-42a3-918d-b31233f7ec7c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 28484 microversion: 2.20 time: 0.175608 Dec 15 13:05:24.555242 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 115/207] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:05:24 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 28484 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:05:24.564772 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ce5372d3-43c3-4b59-aca4-e16dbe292998 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:24.569118 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ce5372d3-43c3-4b59-aca4-e16dbe292998 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: c88af1c7-5239-4287-833a-fddf3ae94e88] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:24.593388 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce5372d3-43c3-4b59-aca4-e16dbe292998 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:24.594231 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce5372d3-43c3-4b59-aca4-e16dbe292998 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:24.595299 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce5372d3-43c3-4b59-aca4-e16dbe292998 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:24.595988 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce5372d3-43c3-4b59-aca4-e16dbe292998 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:25.264503 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-0c752f97-7062-444b-b5bb-693068119314 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Flavor limits 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:05:25.265078 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-0c752f97-7062-444b-b5bb-693068119314 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Image limits 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:05:25.265434 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-0c752f97-7062-444b-b5bb-693068119314 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Flavor pref 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:05:25.266002 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-0c752f97-7062-444b-b5bb-693068119314 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Image pref 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:05:25.267069 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-0c752f97-7062-444b-b5bb-693068119314 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:05:25.301917 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0c752f97-7062-444b-b5bb-693068119314 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:25.302416 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0c752f97-7062-444b-b5bb-693068119314 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:25.303224 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0c752f97-7062-444b-b5bb-693068119314 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:25.303660 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0c752f97-7062-444b-b5bb-693068119314 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:25.392230 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-0c752f97-7062-444b-b5bb-693068119314 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Getting quotas for project 3c8d022ad9f948729c91e72aed09c8cd. Resources: {'instances', 'cores', 'ram'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:05:25.404374 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-0c752f97-7062-444b-b5bb-693068119314 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Getting quotas for user a40300c1b04e4f3c9e9063c1d0d47a9a and project 3c8d022ad9f948729c91e72aed09c8cd. Resources: {'instances', 'cores', 'ram'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:05:25.407518 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ce5372d3-43c3-4b59-aca4-e16dbe292998 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:25.419338 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ce5372d3-43c3-4b59-aca4-e16dbe292998 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88" status: 200 len: 1507 microversion: 2.1 time: 0.860368 Dec 15 13:05:25.419880 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 116/208] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:24 2021] GET /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88 => generated 1507 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:25.434839 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-0c752f97-7062-444b-b5bb-693068119314 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Going to run 1 instances... {{(pid=116097) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:05:25.438659 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-0c752f97-7062-444b-b5bb-693068119314 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67890983-693f-44ed-bdf3-22321abeab26',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:05:25.445322 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-92c735b6-a4dc-4e76-a7e7-bc0255278f86 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:25.446364 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-92c735b6-a4dc-4e76-a7e7-bc0255278f86 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:25.468013 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-92c735b6-a4dc-4e76-a7e7-bc0255278f86 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:25.468485 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-92c735b6-a4dc-4e76-a7e7-bc0255278f86 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:25.469324 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-92c735b6-a4dc-4e76-a7e7-bc0255278f86 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:25.470405 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-92c735b6-a4dc-4e76-a7e7-bc0255278f86 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:25.573458 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-92c735b6-a4dc-4e76-a7e7-bc0255278f86 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 28610 microversion: 2.1 time: 0.152320 Dec 15 13:05:25.574529 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 117/209] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:05:25 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 28610 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:05:25.576722 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-0c752f97-7062-444b-b5bb-693068119314 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.937301 Dec 15 13:05:25.577345 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 93/210] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Dec 15 13:05:23 2021] POST /compute/v2.1/servers => generated 383 bytes in 1939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:05:25.591843 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f73bb2e8-cc23-49e7-b8e0-3bd9e2497614 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:25.599602 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f73bb2e8-cc23-49e7-b8e0-3bd9e2497614 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:25.601372 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-f88b5614-9614-4c96-878a-98f6b431d58b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "927fcb3e-64e2-42e8-a3ef-6c8d345e32a7"}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:25.602561 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-f88b5614-9614-4c96-878a-98f6b431d58b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: c88af1c7-5239-4287-833a-fddf3ae94e88] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:25.620583 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f73bb2e8-cc23-49e7-b8e0-3bd9e2497614 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:25.622462 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f73bb2e8-cc23-49e7-b8e0-3bd9e2497614 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:25.623957 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f73bb2e8-cc23-49e7-b8e0-3bd9e2497614 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:25.624570 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f88b5614-9614-4c96-878a-98f6b431d58b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:25.625045 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f88b5614-9614-4c96-878a-98f6b431d58b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:25.625783 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f73bb2e8-cc23-49e7-b8e0-3bd9e2497614 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:25.625921 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f88b5614-9614-4c96-878a-98f6b431d58b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:25.628320 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f88b5614-9614-4c96-878a-98f6b431d58b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:25.784600 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f73bb2e8-cc23-49e7-b8e0-3bd9e2497614 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 28652 microversion: 2.20 time: 0.202532 Dec 15 13:05:25.786704 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 118/211] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:05:25 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 28652 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:05:25.797318 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a8822673-568e-49b6-8e80-bad1fb91df58 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:25.817611 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a8822673-568e-49b6-8e80-bad1fb91df58 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:25.893496 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.wsgi [None req-f88b5614-9614-4c96-878a-98f6b431d58b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] HTTP exception thrown: Invalid volume: volume 927fcb3e-64e2-42e8-a3ef-6c8d345e32a7 is already attached to instances: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff Dec 15 13:05:25.900525 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-f88b5614-9614-4c96-878a-98f6b431d58b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Returning 400 to user: Invalid volume: volume 927fcb3e-64e2-42e8-a3ef-6c8d345e32a7 is already attached to instances: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff {{(pid=116097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:05:25.907311 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-f88b5614-9614-4c96-878a-98f6b431d58b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "POST /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.323248 Dec 15 13:05:25.909488 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 94/212] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Dec 15 13:05:25 2021] POST /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88/os-volume_attachments => generated 174 bytes in 332 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:05:26.020872 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-f386df27-b6ec-4625-8757-54ceeffc58c6 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:26.021529 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-f386df27-b6ec-4625-8757-54ceeffc58c6 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:26.032931 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f386df27-b6ec-4625-8757-54ceeffc58c6 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:26.033487 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f386df27-b6ec-4625-8757-54ceeffc58c6 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:26.034640 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f386df27-b6ec-4625-8757-54ceeffc58c6 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:26.035357 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f386df27-b6ec-4625-8757-54ceeffc58c6 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:26.467273 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.objects.instance [None req-f386df27-b6ec-4625-8757-54ceeffc58c6 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lazy-loading 'services' on Instance uuid fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff {{(pid=116097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:05:26.667120 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a8822673-568e-49b6-8e80-bad1fb91df58 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:26.693829 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a8822673-568e-49b6-8e80-bad1fb91df58 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1220 microversion: 2.1 time: 0.905148 Dec 15 13:05:26.725864 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 119/213] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:25 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1220 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:26.778535 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c3b1be74-5fb1-4373-b3ab-288466300757 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:26.779621 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-f386df27-b6ec-4625-8757-54ceeffc58c6 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "DELETE /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff/os-volume_attachments/927fcb3e-64e2-42e8-a3ef-6c8d345e32a7" status: 202 len: 0 microversion: 2.1 time: 0.761232 Dec 15 13:05:26.782316 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 95/214] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Dec 15 13:05:26 2021] DELETE /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff/os-volume_attachments/927fcb3e-64e2-42e8-a3ef-6c8d345e32a7 => generated 0 bytes in 767 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:05:26.830751 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c3b1be74-5fb1-4373-b3ab-288466300757 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:26.875046 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-28658648-8a16-49a6-be78-378246f440c1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:26.877837 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-28658648-8a16-49a6-be78-378246f440c1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:26.878185 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c3b1be74-5fb1-4373-b3ab-288466300757 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:26.880071 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c3b1be74-5fb1-4373-b3ab-288466300757 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:26.881153 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c3b1be74-5fb1-4373-b3ab-288466300757 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:26.881596 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c3b1be74-5fb1-4373-b3ab-288466300757 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:26.898784 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-28658648-8a16-49a6-be78-378246f440c1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:26.899283 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-28658648-8a16-49a6-be78-378246f440c1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:26.900420 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-28658648-8a16-49a6-be78-378246f440c1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:26.900938 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-28658648-8a16-49a6-be78-378246f440c1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:26.949988 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-28658648-8a16-49a6-be78-378246f440c1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113225 Dec 15 13:05:26.950845 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 96/215] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:05:26 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:05:26.971801 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-4970d827-4f89-48e8-8dfb-af4e17004230 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:26.973331 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-4970d827-4f89-48e8-8dfb-af4e17004230 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:27.017408 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4970d827-4f89-48e8-8dfb-af4e17004230 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:27.018280 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4970d827-4f89-48e8-8dfb-af4e17004230 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:27.019372 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4970d827-4f89-48e8-8dfb-af4e17004230 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:27.021439 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4970d827-4f89-48e8-8dfb-af4e17004230 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:27.039908 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c3b1be74-5fb1-4373-b3ab-288466300757 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 28610 microversion: 2.1 time: 0.312075 Dec 15 13:05:27.040989 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 120/216] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:05:26 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 28610 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:05:27.066666 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7d382e2a-0226-48c8-b0d4-4e1518c3d4b0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2059690699", "imageRef": "67890983-693f-44ed-bdf3-22321abeab26", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9f17b8fd-07d6-4b12-8085-ba9909eaa2da"}]}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:27.251229 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.network.neutron [None req-7d382e2a-0226-48c8-b0d4-4e1518c3d4b0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] validate_networks() for [('9f17b8fd-07d6-4b12-8085-ba9909eaa2da', None, None, None, None, None)] {{(pid=116098) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:05:27.500524 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-4970d827-4f89-48e8-8dfb-af4e17004230 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 28652 microversion: 2.20 time: 0.546620 Dec 15 13:05:27.501867 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 97/217] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:05:26 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 28652 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:05:27.963581 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-22ee9038-a1b3-4d6e-a60f-b4b01a3f6734 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:27.964591 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-22ee9038-a1b3-4d6e-a60f-b4b01a3f6734 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:27.989275 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-22ee9038-a1b3-4d6e-a60f-b4b01a3f6734 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:27.992803 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-22ee9038-a1b3-4d6e-a60f-b4b01a3f6734 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:27.996760 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-22ee9038-a1b3-4d6e-a60f-b4b01a3f6734 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:27.998736 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-22ee9038-a1b3-4d6e-a60f-b4b01a3f6734 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:28.142638 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-22ee9038-a1b3-4d6e-a60f-b4b01a3f6734 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.178817 Dec 15 13:05:28.151653 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 98/218] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:05:27 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff/os-volume_attachments => generated 25 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:05:28.163884 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-b5a6b6a0-4bed-4d8d-9c23-2b243d9038c9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:28.171141 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-b5a6b6a0-4bed-4d8d-9c23-2b243d9038c9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:28.184782 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b5a6b6a0-4bed-4d8d-9c23-2b243d9038c9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:28.185733 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b5a6b6a0-4bed-4d8d-9c23-2b243d9038c9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:28.186765 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b5a6b6a0-4bed-4d8d-9c23-2b243d9038c9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:28.190478 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b5a6b6a0-4bed-4d8d-9c23-2b243d9038c9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:28.331592 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-b5a6b6a0-4bed-4d8d-9c23-2b243d9038c9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 28610 microversion: 2.1 time: 0.178245 Dec 15 13:05:28.337527 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 99/219] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:05:28 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 28610 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:05:28.514215 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-955bbd3d-567b-4f21-a45e-2b5143a665b2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:28.517495 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-955bbd3d-567b-4f21-a45e-2b5143a665b2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:28.534004 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-955bbd3d-567b-4f21-a45e-2b5143a665b2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:28.535638 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-955bbd3d-567b-4f21-a45e-2b5143a665b2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:28.537095 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-955bbd3d-567b-4f21-a45e-2b5143a665b2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:28.552726 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-955bbd3d-567b-4f21-a45e-2b5143a665b2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:28.647366 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-7d382e2a-0226-48c8-b0d4-4e1518c3d4b0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Flavor limits 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:05:28.649148 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-7d382e2a-0226-48c8-b0d4-4e1518c3d4b0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Image limits 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:05:28.650036 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-7d382e2a-0226-48c8-b0d4-4e1518c3d4b0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Flavor pref 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:05:28.650787 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-7d382e2a-0226-48c8-b0d4-4e1518c3d4b0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Image pref 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:05:28.651370 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-7d382e2a-0226-48c8-b0d4-4e1518c3d4b0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:05:28.677363 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7d382e2a-0226-48c8-b0d4-4e1518c3d4b0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:28.677820 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7d382e2a-0226-48c8-b0d4-4e1518c3d4b0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:28.678771 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7d382e2a-0226-48c8-b0d4-4e1518c3d4b0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:28.686520 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7d382e2a-0226-48c8-b0d4-4e1518c3d4b0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:28.712661 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-955bbd3d-567b-4f21-a45e-2b5143a665b2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 28652 microversion: 2.20 time: 0.202935 Dec 15 13:05:28.716897 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 100/220] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:05:28 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 28652 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:05:28.722977 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-7c89abd1-640e-4a87-a2fe-88b8eace15bf tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1782777251", "imageRef": "67890983-693f-44ed-bdf3-22321abeab26", "flavorRef": "452", "networks": [{"uuid": "162c3d0f-e234-47fd-9154-3a362a7fadde"}]}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:28.758802 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-7d382e2a-0226-48c8-b0d4-4e1518c3d4b0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Getting quotas for project 3c8d022ad9f948729c91e72aed09c8cd. Resources: {'instances', 'cores', 'ram'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:05:28.774510 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-7d382e2a-0226-48c8-b0d4-4e1518c3d4b0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Getting quotas for user a40300c1b04e4f3c9e9063c1d0d47a9a and project 3c8d022ad9f948729c91e72aed09c8cd. Resources: {'instances', 'cores', 'ram'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:05:28.813520 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7d382e2a-0226-48c8-b0d4-4e1518c3d4b0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Going to run 1 instances... {{(pid=116098) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:05:28.817166 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7d382e2a-0226-48c8-b0d4-4e1518c3d4b0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67890983-693f-44ed-bdf3-22321abeab26',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:05:28.870306 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.network.neutron [None req-7c89abd1-640e-4a87-a2fe-88b8eace15bf tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] validate_networks() for [('162c3d0f-e234-47fd-9154-3a362a7fadde', None, None, None, None, None)] {{(pid=116097) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:05:28.966274 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7d382e2a-0226-48c8-b0d4-4e1518c3d4b0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.916516 Dec 15 13:05:28.974503 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 121/221] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Dec 15 13:05:27 2021] POST /compute/v2.1/servers => generated 383 bytes in 1933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:05:28.982770 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f1c676d8-353e-4334-aa9d-5037f2212dfe tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:28.986399 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f1c676d8-353e-4334-aa9d-5037f2212dfe tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:29.172512 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f1c676d8-353e-4334-aa9d-5037f2212dfe tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:29.179958 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f1c676d8-353e-4334-aa9d-5037f2212dfe tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1222 microversion: 2.1 time: 0.204299 Dec 15 13:05:29.181031 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 122/222] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:28 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1222 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:29.345337 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-08bf6834-60ff-4e00-8824-11ea354f7c97 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:29.346482 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-08bf6834-60ff-4e00-8824-11ea354f7c97 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:29.366559 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-08bf6834-60ff-4e00-8824-11ea354f7c97 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:29.367301 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-08bf6834-60ff-4e00-8824-11ea354f7c97 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:29.368376 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-08bf6834-60ff-4e00-8824-11ea354f7c97 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:29.369349 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-08bf6834-60ff-4e00-8824-11ea354f7c97 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:29.473493 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-08bf6834-60ff-4e00-8824-11ea354f7c97 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 28635 microversion: 2.1 time: 0.131708 Dec 15 13:05:29.475229 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 123/223] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:05:29 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 28635 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:05:29.729536 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-438b94ae-1de2-46da-9e16-b2a91e3a5a1d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:29.731304 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-438b94ae-1de2-46da-9e16-b2a91e3a5a1d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:29.760033 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-438b94ae-1de2-46da-9e16-b2a91e3a5a1d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:29.761227 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-438b94ae-1de2-46da-9e16-b2a91e3a5a1d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:29.763511 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-438b94ae-1de2-46da-9e16-b2a91e3a5a1d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:29.767428 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-438b94ae-1de2-46da-9e16-b2a91e3a5a1d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:29.914810 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-438b94ae-1de2-46da-9e16-b2a91e3a5a1d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 28652 microversion: 2.20 time: 0.189852 Dec 15 13:05:29.918955 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 124/224] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:05:29 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 28652 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:05:30.201019 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8cf4e51a-9569-4e64-9433-a10db6776720 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:30.202034 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8cf4e51a-9569-4e64-9433-a10db6776720 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:30.220930 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8cf4e51a-9569-4e64-9433-a10db6776720 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:30.221582 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8cf4e51a-9569-4e64-9433-a10db6776720 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:30.222570 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8cf4e51a-9569-4e64-9433-a10db6776720 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:30.223161 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8cf4e51a-9569-4e64-9433-a10db6776720 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:30.361584 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-7c89abd1-640e-4a87-a2fe-88b8eace15bf tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Flavor limits 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:05:30.362137 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-7c89abd1-640e-4a87-a2fe-88b8eace15bf tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Image limits 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:05:30.363971 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-7c89abd1-640e-4a87-a2fe-88b8eace15bf tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Flavor pref 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:05:30.364457 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-7c89abd1-640e-4a87-a2fe-88b8eace15bf tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Image pref 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:05:30.365045 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-7c89abd1-640e-4a87-a2fe-88b8eace15bf tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:05:30.402465 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7c89abd1-640e-4a87-a2fe-88b8eace15bf tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:30.402465 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7c89abd1-640e-4a87-a2fe-88b8eace15bf tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:30.403633 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7c89abd1-640e-4a87-a2fe-88b8eace15bf tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:30.404201 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7c89abd1-640e-4a87-a2fe-88b8eace15bf tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:30.442437 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-7c89abd1-640e-4a87-a2fe-88b8eace15bf tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Getting quotas for project 04e0b910ad794c7db450e6bb1c96cd01. Resources: {'instances', 'cores', 'ram'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:05:30.454594 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8cf4e51a-9569-4e64-9433-a10db6776720 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:30.459787 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-7c89abd1-640e-4a87-a2fe-88b8eace15bf tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Getting quotas for user 1b47404ef24941829d657acb729f93da and project 04e0b910ad794c7db450e6bb1c96cd01. Resources: {'instances', 'cores', 'ram'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:05:30.465712 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8cf4e51a-9569-4e64-9433-a10db6776720 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1274 microversion: 2.1 time: 0.271754 Dec 15 13:05:30.467957 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 125/225] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:30 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1274 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:05:30.485592 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-02085329-d861-4b01-8411-9a37964b3d8b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:30.501768 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-02085329-d861-4b01-8411-9a37964b3d8b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:30.505609 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-7c89abd1-640e-4a87-a2fe-88b8eace15bf tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Going to run 1 instances... {{(pid=116097) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:05:30.515595 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-02085329-d861-4b01-8411-9a37964b3d8b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:30.516338 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-02085329-d861-4b01-8411-9a37964b3d8b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:30.516883 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-7c89abd1-640e-4a87-a2fe-88b8eace15bf tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67890983-693f-44ed-bdf3-22321abeab26',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:05:30.538793 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-02085329-d861-4b01-8411-9a37964b3d8b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:30.539431 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-02085329-d861-4b01-8411-9a37964b3d8b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:30.648465 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-7c89abd1-640e-4a87-a2fe-88b8eace15bf tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.929259 Dec 15 13:05:30.649997 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 101/226] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Dec 15 13:05:28 2021] POST /compute/v2.1/servers => generated 380 bytes in 1932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:05:30.660138 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-cc0af4b3-06b6-48df-99f1-7dbe03ace62a tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:30.661225 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-cc0af4b3-06b6-48df-99f1-7dbe03ace62a tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:30.719446 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-02085329-d861-4b01-8411-9a37964b3d8b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 29767 microversion: 2.1 time: 0.238127 Dec 15 13:05:30.730415 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 126/227] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:05:30 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 29767 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:05:30.844285 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-cc0af4b3-06b6-48df-99f1-7dbe03ace62a tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:30.857426 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-cc0af4b3-06b6-48df-99f1-7dbe03ace62a tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1218 microversion: 2.1 time: 0.201676 Dec 15 13:05:30.858484 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 102/228] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:30 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1218 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:30.930243 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-121c3219-d156-4f00-bc70-4a7c7ac3f179 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:30.934781 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-121c3219-d156-4f00-bc70-4a7c7ac3f179 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:30.979187 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-121c3219-d156-4f00-bc70-4a7c7ac3f179 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:30.988110 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-121c3219-d156-4f00-bc70-4a7c7ac3f179 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:30.991374 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-121c3219-d156-4f00-bc70-4a7c7ac3f179 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:30.992054 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-121c3219-d156-4f00-bc70-4a7c7ac3f179 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:31.207363 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-121c3219-d156-4f00-bc70-4a7c7ac3f179 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 28677 microversion: 2.20 time: 0.279981 Dec 15 13:05:31.211565 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 127/229] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:05:30 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 28677 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:05:31.489714 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-d95e658c-03cd-476b-b6fc-4111c3be2575 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:31.491691 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-d95e658c-03cd-476b-b6fc-4111c3be2575 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:31.524023 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d95e658c-03cd-476b-b6fc-4111c3be2575 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:31.529386 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d95e658c-03cd-476b-b6fc-4111c3be2575 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:31.531836 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d95e658c-03cd-476b-b6fc-4111c3be2575 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:31.534308 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d95e658c-03cd-476b-b6fc-4111c3be2575 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:31.656126 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-d95e658c-03cd-476b-b6fc-4111c3be2575 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:31.675939 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-d95e658c-03cd-476b-b6fc-4111c3be2575 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1280 microversion: 2.1 time: 0.192283 Dec 15 13:05:31.678106 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 103/230] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:31 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1280 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:31.744168 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-892d6ecb-733d-46a8-904e-c838c2a83e39 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:31.745193 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-892d6ecb-733d-46a8-904e-c838c2a83e39 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:31.776172 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-892d6ecb-733d-46a8-904e-c838c2a83e39 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:31.779392 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-892d6ecb-733d-46a8-904e-c838c2a83e39 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:31.784575 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-892d6ecb-733d-46a8-904e-c838c2a83e39 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:31.785091 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-892d6ecb-733d-46a8-904e-c838c2a83e39 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:31.874916 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-090f2ddf-8fcc-4c1f-b30f-40bd5c960ba5 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:31.876681 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-090f2ddf-8fcc-4c1f-b30f-40bd5c960ba5 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:31.911618 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-090f2ddf-8fcc-4c1f-b30f-40bd5c960ba5 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:31.912114 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-090f2ddf-8fcc-4c1f-b30f-40bd5c960ba5 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:31.912935 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-090f2ddf-8fcc-4c1f-b30f-40bd5c960ba5 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:31.913422 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-090f2ddf-8fcc-4c1f-b30f-40bd5c960ba5 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:31.963809 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-892d6ecb-733d-46a8-904e-c838c2a83e39 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 30964 microversion: 2.1 time: 0.225389 Dec 15 13:05:31.965135 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 128/231] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:05:31 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 30964 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:05:31.975677 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-1c6d6afe-7609-4f65-a09c-2c84b17038ee req-4d954d3e-a5c1-4cc9-b005-62a63f73f2a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46358568-c4cc-4dd2-81e7-c724c57ee533", "tag": "aa929dda-dd0a-496e-be64-c71315b589f5"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:31.983023 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:05:31.983023 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:05:32.004219 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-1c6d6afe-7609-4f65-a09c-2c84b17038ee req-4d954d3e-a5c1-4cc9-b005-62a63f73f2a2 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:32.004667 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-1c6d6afe-7609-4f65-a09c-2c84b17038ee req-4d954d3e-a5c1-4cc9-b005-62a63f73f2a2 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:32.028847 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-1c6d6afe-7609-4f65-a09c-2c84b17038ee req-4d954d3e-a5c1-4cc9-b005-62a63f73f2a2 service nova] Creating event network-changed:aa929dda-dd0a-496e-be64-c71315b589f5 for instance 46358568-c4cc-4dd2-81e7-c724c57ee533 on hv-cinder-81322 Dec 15 13:05:32.054476 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-1c6d6afe-7609-4f65-a09c-2c84b17038ee req-4d954d3e-a5c1-4cc9-b005-62a63f73f2a2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082959 Dec 15 13:05:32.062482 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 129/232] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:05:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:05:32.224264 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b1dbb41d-c3cd-4586-989a-775f3a9380e0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:32.225455 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b1dbb41d-c3cd-4586-989a-775f3a9380e0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:32.235746 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b1dbb41d-c3cd-4586-989a-775f3a9380e0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:32.236280 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b1dbb41d-c3cd-4586-989a-775f3a9380e0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:32.237128 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b1dbb41d-c3cd-4586-989a-775f3a9380e0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:32.237626 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b1dbb41d-c3cd-4586-989a-775f3a9380e0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:32.392644 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b1dbb41d-c3cd-4586-989a-775f3a9380e0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 29656 microversion: 2.20 time: 0.173694 Dec 15 13:05:32.394335 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-090f2ddf-8fcc-4c1f-b30f-40bd5c960ba5 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:32.399640 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 130/233] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:05:32 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 29656 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:05:32.407938 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-090f2ddf-8fcc-4c1f-b30f-40bd5c960ba5 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1214 microversion: 2.1 time: 0.535210 Dec 15 13:05:32.409076 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 104/234] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:31 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1214 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:05:32.698734 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6d553878-f907-4daa-87d9-e46d037958fa tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:32.703615 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-6d553878-f907-4daa-87d9-e46d037958fa tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:32.714570 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6d553878-f907-4daa-87d9-e46d037958fa tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:32.716898 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6d553878-f907-4daa-87d9-e46d037958fa tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:32.720491 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6d553878-f907-4daa-87d9-e46d037958fa tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:32.721132 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6d553878-f907-4daa-87d9-e46d037958fa tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:32.965197 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-6d553878-f907-4daa-87d9-e46d037958fa tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:32.979106 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6d553878-f907-4daa-87d9-e46d037958fa tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1280 microversion: 2.1 time: 0.287666 Dec 15 13:05:32.979688 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 131/235] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:32 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1280 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:32.982947 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-3e59b90b-bd5f-4c08-924a-ea289cb66cc1 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:32.985018 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-3e59b90b-bd5f-4c08-924a-ea289cb66cc1 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:32.993566 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3e59b90b-bd5f-4c08-924a-ea289cb66cc1 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:32.997345 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3e59b90b-bd5f-4c08-924a-ea289cb66cc1 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:32.998618 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3e59b90b-bd5f-4c08-924a-ea289cb66cc1 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:32.999330 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3e59b90b-bd5f-4c08-924a-ea289cb66cc1 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:33.133266 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-3e59b90b-bd5f-4c08-924a-ea289cb66cc1 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 32363 microversion: 2.1 time: 0.157866 Dec 15 13:05:33.138845 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 105/236] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:05:32 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 32363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:05:33.410134 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d6ce655a-8167-45f1-87c6-318ed474d65f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:33.411087 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d6ce655a-8167-45f1-87c6-318ed474d65f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:33.421256 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d6ce655a-8167-45f1-87c6-318ed474d65f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:33.421976 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d6ce655a-8167-45f1-87c6-318ed474d65f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:33.423082 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d6ce655a-8167-45f1-87c6-318ed474d65f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:33.423674 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d6ce655a-8167-45f1-87c6-318ed474d65f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:33.428504 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-b307a5f0-3863-47e2-a508-aba8f9c0847d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:33.429213 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-b307a5f0-3863-47e2-a508-aba8f9c0847d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:33.443801 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b307a5f0-3863-47e2-a508-aba8f9c0847d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:33.444460 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b307a5f0-3863-47e2-a508-aba8f9c0847d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:33.446269 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b307a5f0-3863-47e2-a508-aba8f9c0847d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:33.446894 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b307a5f0-3863-47e2-a508-aba8f9c0847d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:33.539414 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d6ce655a-8167-45f1-87c6-318ed474d65f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 30918 microversion: 2.20 time: 0.132926 Dec 15 13:05:33.542223 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 132/237] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:05:33 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 30918 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:05:33.561122 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-b307a5f0-3863-47e2-a508-aba8f9c0847d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:33.572152 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-b307a5f0-3863-47e2-a508-aba8f9c0847d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1276 microversion: 2.1 time: 0.149935 Dec 15 13:05:33.573119 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 106/238] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:33 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1276 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:05:34.000113 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ad9a3b29-46dd-4b84-91b0-d3178cf8e310 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:34.000863 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ad9a3b29-46dd-4b84-91b0-d3178cf8e310 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:34.007932 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ad9a3b29-46dd-4b84-91b0-d3178cf8e310 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:34.008782 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ad9a3b29-46dd-4b84-91b0-d3178cf8e310 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:34.009757 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ad9a3b29-46dd-4b84-91b0-d3178cf8e310 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:34.010403 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ad9a3b29-46dd-4b84-91b0-d3178cf8e310 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:34.145546 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-de5d0cf2-c5f5-4c4e-b1d3-251f9d4d52f6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:34.146693 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-de5d0cf2-c5f5-4c4e-b1d3-251f9d4d52f6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:34.154501 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-de5d0cf2-c5f5-4c4e-b1d3-251f9d4d52f6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:34.155380 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-de5d0cf2-c5f5-4c4e-b1d3-251f9d4d52f6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:34.157002 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-de5d0cf2-c5f5-4c4e-b1d3-251f9d4d52f6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:34.157623 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-de5d0cf2-c5f5-4c4e-b1d3-251f9d4d52f6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:34.253035 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-de5d0cf2-c5f5-4c4e-b1d3-251f9d4d52f6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 33071 microversion: 2.1 time: 0.111682 Dec 15 13:05:34.253685 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 107/239] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:05:34 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 33071 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:05:34.552764 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-74f70a02-99de-4498-b549-cb573bcc1675 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:34.553777 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-74f70a02-99de-4498-b549-cb573bcc1675 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:34.564477 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-74f70a02-99de-4498-b549-cb573bcc1675 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:34.564922 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-74f70a02-99de-4498-b549-cb573bcc1675 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:34.565712 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-74f70a02-99de-4498-b549-cb573bcc1675 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:34.575190 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-74f70a02-99de-4498-b549-cb573bcc1675 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:34.646258 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ad9a3b29-46dd-4b84-91b0-d3178cf8e310 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:34.655395 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ad9a3b29-46dd-4b84-91b0-d3178cf8e310 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1322 microversion: 2.1 time: 0.662697 Dec 15 13:05:34.657323 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 133/240] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:33 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1322 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:34.662263 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f082c97f-b162-48fe-8871-542d80a17917 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:34.663110 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f082c97f-b162-48fe-8871-542d80a17917 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:34.672662 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f082c97f-b162-48fe-8871-542d80a17917 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:34.674286 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f082c97f-b162-48fe-8871-542d80a17917 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:34.682429 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f082c97f-b162-48fe-8871-542d80a17917 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:34.686809 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f082c97f-b162-48fe-8871-542d80a17917 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:34.714778 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-74f70a02-99de-4498-b549-cb573bcc1675 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 31716 microversion: 2.20 time: 0.166027 Dec 15 13:05:34.716304 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 108/241] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:05:34 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 31716 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:05:35.269191 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-9531697d-2608-46b4-a4c2-ee09a20bef67 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:35.272735 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-9531697d-2608-46b4-a4c2-ee09a20bef67 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:35.279792 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f082c97f-b162-48fe-8871-542d80a17917 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:35.282928 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9531697d-2608-46b4-a4c2-ee09a20bef67 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:35.287125 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9531697d-2608-46b4-a4c2-ee09a20bef67 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:35.288210 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9531697d-2608-46b4-a4c2-ee09a20bef67 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:35.290100 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9531697d-2608-46b4-a4c2-ee09a20bef67 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:35.301530 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f082c97f-b162-48fe-8871-542d80a17917 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1318 microversion: 2.1 time: 0.642787 Dec 15 13:05:35.314623 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 134/242] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:34 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1318 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:35.426712 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-9531697d-2608-46b4-a4c2-ee09a20bef67 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 33521 microversion: 2.1 time: 0.163015 Dec 15 13:05:35.427766 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 109/243] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:05:35 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 33521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:05:35.430262 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-9f494609-1066-457d-b66d-64ee67de5a17 req-9ecef3fe-0772-45a7-a853-5345e5f017b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51ca60f9-e96a-440a-83dc-000777505c22", "tag": "ce8f94af-f208-4b78-8ade-7227976a0dfd"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:35.432536 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:05:35.432536 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:05:35.441575 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-9f494609-1066-457d-b66d-64ee67de5a17 req-9ecef3fe-0772-45a7-a853-5345e5f017b8 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:35.442381 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-9f494609-1066-457d-b66d-64ee67de5a17 req-9ecef3fe-0772-45a7-a853-5345e5f017b8 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:35.464559 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-9f494609-1066-457d-b66d-64ee67de5a17 req-9ecef3fe-0772-45a7-a853-5345e5f017b8 service nova] Creating event network-changed:ce8f94af-f208-4b78-8ade-7227976a0dfd for instance 51ca60f9-e96a-440a-83dc-000777505c22 on hv-cinder-81322 Dec 15 13:05:35.474944 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-9f494609-1066-457d-b66d-64ee67de5a17 req-9ecef3fe-0772-45a7-a853-5345e5f017b8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048315 Dec 15 13:05:35.476151 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 135/244] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:05:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:05:35.673515 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-2624d713-32c5-4726-9d2d-f5b10542fbf5 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:35.674306 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-2624d713-32c5-4726-9d2d-f5b10542fbf5 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:35.685374 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2624d713-32c5-4726-9d2d-f5b10542fbf5 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:35.685796 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2624d713-32c5-4726-9d2d-f5b10542fbf5 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:35.686865 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2624d713-32c5-4726-9d2d-f5b10542fbf5 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:35.688215 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2624d713-32c5-4726-9d2d-f5b10542fbf5 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:35.728791 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-76d8ee1f-084f-4a25-bd9d-55806d6b9837 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:35.730040 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-76d8ee1f-084f-4a25-bd9d-55806d6b9837 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:35.740012 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76d8ee1f-084f-4a25-bd9d-55806d6b9837 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:35.740723 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76d8ee1f-084f-4a25-bd9d-55806d6b9837 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:35.742459 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76d8ee1f-084f-4a25-bd9d-55806d6b9837 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:35.743128 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76d8ee1f-084f-4a25-bd9d-55806d6b9837 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:35.856746 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-76d8ee1f-084f-4a25-bd9d-55806d6b9837 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 32735 microversion: 2.20 time: 0.131209 Dec 15 13:05:35.857577 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 136/245] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:05:35 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 32735 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:05:36.084211 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-2624d713-32c5-4726-9d2d-f5b10542fbf5 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:36.097913 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-2624d713-32c5-4726-9d2d-f5b10542fbf5 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1322 microversion: 2.1 time: 0.428152 Dec 15 13:05:36.108245 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 110/246] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:35 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1322 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:36.325448 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7d0ec13b-4555-4068-9a37-6ff7f6c256c1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:36.326279 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7d0ec13b-4555-4068-9a37-6ff7f6c256c1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:36.338503 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7d0ec13b-4555-4068-9a37-6ff7f6c256c1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:36.339933 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7d0ec13b-4555-4068-9a37-6ff7f6c256c1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:36.340896 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7d0ec13b-4555-4068-9a37-6ff7f6c256c1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:36.341686 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7d0ec13b-4555-4068-9a37-6ff7f6c256c1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:36.353415 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-525a8568-8453-40dc-b12b-b01ee8199a4f req-10ff2918-4e9e-4c82-80e0-0eca9bea673c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5b657b8-e2d6-4365-b369-0accd054202d", "tag": "689e019e-fb09-49a1-a85f-3e8039f5d870"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:36.355952 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:05:36.355952 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:05:36.377623 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-525a8568-8453-40dc-b12b-b01ee8199a4f req-10ff2918-4e9e-4c82-80e0-0eca9bea673c service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:36.384791 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-525a8568-8453-40dc-b12b-b01ee8199a4f req-10ff2918-4e9e-4c82-80e0-0eca9bea673c service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:36.403917 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-525a8568-8453-40dc-b12b-b01ee8199a4f req-10ff2918-4e9e-4c82-80e0-0eca9bea673c service nova] Creating event network-changed:689e019e-fb09-49a1-a85f-3e8039f5d870 for instance e5b657b8-e2d6-4365-b369-0accd054202d on hv-cinder-81322 Dec 15 13:05:36.411150 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-525a8568-8453-40dc-b12b-b01ee8199a4f req-10ff2918-4e9e-4c82-80e0-0eca9bea673c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063175 Dec 15 13:05:36.412649 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 111/247] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:05:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:05:36.446910 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-1ba24767-c690-45b2-ae85-834d4748abb4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:36.448847 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-1ba24767-c690-45b2-ae85-834d4748abb4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:36.464750 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1ba24767-c690-45b2-ae85-834d4748abb4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:36.465257 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1ba24767-c690-45b2-ae85-834d4748abb4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:36.466072 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1ba24767-c690-45b2-ae85-834d4748abb4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:36.466543 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1ba24767-c690-45b2-ae85-834d4748abb4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:36.603074 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-1ba24767-c690-45b2-ae85-834d4748abb4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 34020 microversion: 2.1 time: 0.165954 Dec 15 13:05:36.604546 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 112/248] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:05:36 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 34020 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:05:36.721012 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-7d0ec13b-4555-4068-9a37-6ff7f6c256c1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:36.729069 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7d0ec13b-4555-4068-9a37-6ff7f6c256c1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1318 microversion: 2.1 time: 0.412465 Dec 15 13:05:36.743113 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 137/249] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:36 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1318 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:36.871394 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-cf3d91be-6085-4f89-bfff-fb9bfa6b6955 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:36.872430 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-cf3d91be-6085-4f89-bfff-fb9bfa6b6955 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:36.883071 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cf3d91be-6085-4f89-bfff-fb9bfa6b6955 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:36.883962 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cf3d91be-6085-4f89-bfff-fb9bfa6b6955 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:36.885133 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cf3d91be-6085-4f89-bfff-fb9bfa6b6955 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:36.885732 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cf3d91be-6085-4f89-bfff-fb9bfa6b6955 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:36.995798 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-cf3d91be-6085-4f89-bfff-fb9bfa6b6955 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 33330 microversion: 2.20 time: 0.130189 Dec 15 13:05:36.998226 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 113/250] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:05:36 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 33330 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:05:37.116992 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1afa00f8-40d7-4541-bc14-81352b44077d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:37.117686 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1afa00f8-40d7-4541-bc14-81352b44077d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:37.128959 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1afa00f8-40d7-4541-bc14-81352b44077d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:37.129409 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1afa00f8-40d7-4541-bc14-81352b44077d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:37.130217 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1afa00f8-40d7-4541-bc14-81352b44077d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:37.130652 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1afa00f8-40d7-4541-bc14-81352b44077d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:37.369703 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1afa00f8-40d7-4541-bc14-81352b44077d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:37.381254 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1afa00f8-40d7-4541-bc14-81352b44077d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1322 microversion: 2.1 time: 0.268577 Dec 15 13:05:37.382191 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 138/251] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:37 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:37.619494 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-a2c68d70-26b9-40bb-879f-389f1d3da9c9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:37.621733 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-a2c68d70-26b9-40bb-879f-389f1d3da9c9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:37.639038 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a2c68d70-26b9-40bb-879f-389f1d3da9c9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:37.640035 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a2c68d70-26b9-40bb-879f-389f1d3da9c9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:37.641077 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a2c68d70-26b9-40bb-879f-389f1d3da9c9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:37.641625 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a2c68d70-26b9-40bb-879f-389f1d3da9c9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:37.749711 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8ba2c03e-e612-4e5a-b382-0496317b3847 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:37.751290 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8ba2c03e-e612-4e5a-b382-0496317b3847 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:37.756924 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-a2c68d70-26b9-40bb-879f-389f1d3da9c9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 34640 microversion: 2.1 time: 0.143929 Dec 15 13:05:37.758941 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8ba2c03e-e612-4e5a-b382-0496317b3847 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:37.759095 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 114/252] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:05:37 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 34640 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:05:37.759887 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8ba2c03e-e612-4e5a-b382-0496317b3847 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:37.762963 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8ba2c03e-e612-4e5a-b382-0496317b3847 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:37.768152 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8ba2c03e-e612-4e5a-b382-0496317b3847 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:38.011539 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-33a24d33-d928-4227-b662-72c6d1436e4e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:38.013123 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-33a24d33-d928-4227-b662-72c6d1436e4e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:38.022666 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-33a24d33-d928-4227-b662-72c6d1436e4e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:38.025389 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-33a24d33-d928-4227-b662-72c6d1436e4e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:38.026655 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-33a24d33-d928-4227-b662-72c6d1436e4e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:38.029695 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-33a24d33-d928-4227-b662-72c6d1436e4e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:38.110553 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8ba2c03e-e612-4e5a-b382-0496317b3847 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:38.120845 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8ba2c03e-e612-4e5a-b382-0496317b3847 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1318 microversion: 2.1 time: 0.375044 Dec 15 13:05:38.122814 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 139/253] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:37 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1318 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:38.154466 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-33a24d33-d928-4227-b662-72c6d1436e4e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 33657 microversion: 2.20 time: 0.149410 Dec 15 13:05:38.160249 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 115/254] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:05:38 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 33657 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:05:38.411255 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-050c36b3-5e37-42fc-a443-7beb4d3b17c7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:38.412033 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-050c36b3-5e37-42fc-a443-7beb4d3b17c7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:38.418325 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-050c36b3-5e37-42fc-a443-7beb4d3b17c7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:38.419032 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-050c36b3-5e37-42fc-a443-7beb4d3b17c7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:38.419919 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-050c36b3-5e37-42fc-a443-7beb4d3b17c7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:38.420477 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-050c36b3-5e37-42fc-a443-7beb4d3b17c7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:38.604084 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-050c36b3-5e37-42fc-a443-7beb4d3b17c7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:38.612334 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-050c36b3-5e37-42fc-a443-7beb4d3b17c7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1322 microversion: 2.1 time: 0.205173 Dec 15 13:05:38.613589 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 140/255] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:38 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:38.771800 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-18a6bf05-35b6-4fbb-bdde-ff97568ae2ee tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:38.773066 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-18a6bf05-35b6-4fbb-bdde-ff97568ae2ee tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:38.781622 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-18a6bf05-35b6-4fbb-bdde-ff97568ae2ee tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:38.782200 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-18a6bf05-35b6-4fbb-bdde-ff97568ae2ee tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:38.783246 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-18a6bf05-35b6-4fbb-bdde-ff97568ae2ee tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:38.783704 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-18a6bf05-35b6-4fbb-bdde-ff97568ae2ee tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:38.897402 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-18a6bf05-35b6-4fbb-bdde-ff97568ae2ee tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 35239 microversion: 2.1 time: 0.131747 Dec 15 13:05:38.898050 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 116/256] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:05:38 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 35239 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:05:39.139429 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-db5cc1e0-393a-4c66-94c3-037a697d2ce8 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:39.140139 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-db5cc1e0-393a-4c66-94c3-037a697d2ce8 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:39.147470 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-db5cc1e0-393a-4c66-94c3-037a697d2ce8 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:39.147915 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-db5cc1e0-393a-4c66-94c3-037a697d2ce8 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:39.148696 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-db5cc1e0-393a-4c66-94c3-037a697d2ce8 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:39.149154 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-db5cc1e0-393a-4c66-94c3-037a697d2ce8 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:39.168081 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-a9674a83-8542-402e-8b4c-5bbfd7dbfc5e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:39.169867 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-a9674a83-8542-402e-8b4c-5bbfd7dbfc5e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:39.182431 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a9674a83-8542-402e-8b4c-5bbfd7dbfc5e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:39.182431 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a9674a83-8542-402e-8b4c-5bbfd7dbfc5e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:39.185670 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a9674a83-8542-402e-8b4c-5bbfd7dbfc5e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:39.186951 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a9674a83-8542-402e-8b4c-5bbfd7dbfc5e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:39.315702 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-a9674a83-8542-402e-8b4c-5bbfd7dbfc5e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 34189 microversion: 2.20 time: 0.152964 Dec 15 13:05:39.316611 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 117/257] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:05:39 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 34189 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:05:39.348980 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-db5cc1e0-393a-4c66-94c3-037a697d2ce8 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:39.356636 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-db5cc1e0-393a-4c66-94c3-037a697d2ce8 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1318 microversion: 2.1 time: 0.221462 Dec 15 13:05:39.357215 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 141/258] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:39 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:39.629175 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-5ff3ea75-1fa9-4e67-a0ee-be2f2e61757b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:39.629875 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-5ff3ea75-1fa9-4e67-a0ee-be2f2e61757b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:39.636889 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5ff3ea75-1fa9-4e67-a0ee-be2f2e61757b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:39.637338 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5ff3ea75-1fa9-4e67-a0ee-be2f2e61757b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:39.638135 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5ff3ea75-1fa9-4e67-a0ee-be2f2e61757b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:39.638684 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5ff3ea75-1fa9-4e67-a0ee-be2f2e61757b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:39.781006 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-5ff3ea75-1fa9-4e67-a0ee-be2f2e61757b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:39.788716 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-5ff3ea75-1fa9-4e67-a0ee-be2f2e61757b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1322 microversion: 2.1 time: 0.163447 Dec 15 13:05:39.789502 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 118/259] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:39 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:39.911667 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-dc6b38ab-9701-4b48-99a9-9108beb14dcf tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:39.913456 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-dc6b38ab-9701-4b48-99a9-9108beb14dcf tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:39.919594 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dc6b38ab-9701-4b48-99a9-9108beb14dcf tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:39.920462 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dc6b38ab-9701-4b48-99a9-9108beb14dcf tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:39.921255 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dc6b38ab-9701-4b48-99a9-9108beb14dcf tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:39.922312 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dc6b38ab-9701-4b48-99a9-9108beb14dcf tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:40.011909 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-dc6b38ab-9701-4b48-99a9-9108beb14dcf tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 35767 microversion: 2.1 time: 0.105958 Dec 15 13:05:40.012610 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 142/260] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:05:39 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 35767 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:05:40.214176 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-360ab06a-c66a-428c-a7b3-56eee852d8e9 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1565430799", "imageRef": "67890983-693f-44ed-bdf3-22321abeab26", "flavorRef": "452", "networks": [{"uuid": "77daa3e7-bccf-46d5-b95b-c14f96e66d13"}]}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:40.328540 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5ad25cb8-5422-43da-abe9-818d87518f39 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:40.329710 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5ad25cb8-5422-43da-abe9-818d87518f39 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:40.337037 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5ad25cb8-5422-43da-abe9-818d87518f39 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:40.337484 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5ad25cb8-5422-43da-abe9-818d87518f39 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:40.338301 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5ad25cb8-5422-43da-abe9-818d87518f39 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:40.338734 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5ad25cb8-5422-43da-abe9-818d87518f39 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:40.428101 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5ad25cb8-5422-43da-abe9-818d87518f39 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 34859 microversion: 2.20 time: 0.103655 Dec 15 13:05:40.432369 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 143/261] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:05:40 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 34859 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:05:40.433494 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7bf0ef5a-cf53-4f51-9f61-b9542e6a4b92 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:40.434232 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7bf0ef5a-cf53-4f51-9f61-b9542e6a4b92 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:40.441569 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7bf0ef5a-cf53-4f51-9f61-b9542e6a4b92 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:40.442012 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7bf0ef5a-cf53-4f51-9f61-b9542e6a4b92 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:40.442947 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7bf0ef5a-cf53-4f51-9f61-b9542e6a4b92 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:40.443236 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7bf0ef5a-cf53-4f51-9f61-b9542e6a4b92 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:40.580959 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-7bf0ef5a-cf53-4f51-9f61-b9542e6a4b92 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:40.588490 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7bf0ef5a-cf53-4f51-9f61-b9542e6a4b92 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1318 microversion: 2.1 time: 0.158578 Dec 15 13:05:40.589180 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 144/262] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:40 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:40.806354 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a6c59f8b-8c3e-49fc-8dcd-bc20098d27e3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:40.806956 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a6c59f8b-8c3e-49fc-8dcd-bc20098d27e3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:40.813189 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a6c59f8b-8c3e-49fc-8dcd-bc20098d27e3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:40.813640 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a6c59f8b-8c3e-49fc-8dcd-bc20098d27e3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:40.814438 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a6c59f8b-8c3e-49fc-8dcd-bc20098d27e3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:40.814871 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a6c59f8b-8c3e-49fc-8dcd-bc20098d27e3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:40.944912 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a6c59f8b-8c3e-49fc-8dcd-bc20098d27e3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:40.953343 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a6c59f8b-8c3e-49fc-8dcd-bc20098d27e3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1322 microversion: 2.1 time: 0.150611 Dec 15 13:05:40.953899 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 145/263] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:40 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:05:41.024521 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9f314844-33b0-4283-b59c-8e0056588610 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:41.025651 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9f314844-33b0-4283-b59c-8e0056588610 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:41.032135 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9f314844-33b0-4283-b59c-8e0056588610 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:41.032580 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9f314844-33b0-4283-b59c-8e0056588610 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:41.033340 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9f314844-33b0-4283-b59c-8e0056588610 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:41.033769 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9f314844-33b0-4283-b59c-8e0056588610 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:41.122714 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9f314844-33b0-4283-b59c-8e0056588610 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 36631 microversion: 2.1 time: 0.101820 Dec 15 13:05:41.123349 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 146/264] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:05:41 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 36631 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:05:41.299509 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-7562994d-0785-489d-b744-fff66cf750e0 req-2f3b48d1-d776-4ba2-90fb-933e4cb44bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46358568-c4cc-4dd2-81e7-c724c57ee533", "name": "network-vif-plugged", "status": "completed", "tag": "aa929dda-dd0a-496e-be64-c71315b589f5"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:41.300991 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:05:41.300991 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:05:41.309318 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-7562994d-0785-489d-b744-fff66cf750e0 req-2f3b48d1-d776-4ba2-90fb-933e4cb44bd4 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:41.310984 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-7562994d-0785-489d-b744-fff66cf750e0 req-2f3b48d1-d776-4ba2-90fb-933e4cb44bd4 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:41.322418 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-7562994d-0785-489d-b744-fff66cf750e0 req-2f3b48d1-d776-4ba2-90fb-933e4cb44bd4 service nova] Creating event network-vif-plugged:aa929dda-dd0a-496e-be64-c71315b589f5 for instance 46358568-c4cc-4dd2-81e7-c724c57ee533 on hv-cinder-81322 Dec 15 13:05:41.327046 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-7562994d-0785-489d-b744-fff66cf750e0 req-2f3b48d1-d776-4ba2-90fb-933e4cb44bd4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031489 Dec 15 13:05:41.327709 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 147/265] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:05:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:05:41.441730 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-938db659-6df5-4c93-81e0-0431d6cb11c4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:41.442672 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-938db659-6df5-4c93-81e0-0431d6cb11c4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:41.449127 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-938db659-6df5-4c93-81e0-0431d6cb11c4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:41.449616 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-938db659-6df5-4c93-81e0-0431d6cb11c4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:41.450477 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-938db659-6df5-4c93-81e0-0431d6cb11c4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:41.450950 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-938db659-6df5-4c93-81e0-0431d6cb11c4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:41.544859 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-938db659-6df5-4c93-81e0-0431d6cb11c4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 35589 microversion: 2.20 time: 0.108482 Dec 15 13:05:41.545513 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 148/266] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:05:41 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 35589 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:05:41.605037 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-024ae12f-dc88-4755-8047-3db35a9cd50b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:41.605759 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-024ae12f-dc88-4755-8047-3db35a9cd50b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:41.613161 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-024ae12f-dc88-4755-8047-3db35a9cd50b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:41.613607 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-024ae12f-dc88-4755-8047-3db35a9cd50b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:41.614436 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-024ae12f-dc88-4755-8047-3db35a9cd50b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:41.614869 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-024ae12f-dc88-4755-8047-3db35a9cd50b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:41.747490 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-024ae12f-dc88-4755-8047-3db35a9cd50b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:41.754869 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-024ae12f-dc88-4755-8047-3db35a9cd50b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1318 microversion: 2.1 time: 0.153803 Dec 15 13:05:41.755457 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 149/267] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:41 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:41.970974 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8b5ec301-e7db-46d4-8471-ffac7680d8d3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:41.971601 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8b5ec301-e7db-46d4-8471-ffac7680d8d3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:41.977678 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8b5ec301-e7db-46d4-8471-ffac7680d8d3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:41.978198 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8b5ec301-e7db-46d4-8471-ffac7680d8d3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:41.978966 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8b5ec301-e7db-46d4-8471-ffac7680d8d3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:41.979395 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8b5ec301-e7db-46d4-8471-ffac7680d8d3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:42.110032 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8b5ec301-e7db-46d4-8471-ffac7680d8d3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:42.117079 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8b5ec301-e7db-46d4-8471-ffac7680d8d3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1322 microversion: 2.1 time: 0.150410 Dec 15 13:05:42.117631 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 150/268] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:41 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:05:42.133972 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-559e6a56-5763-4687-a9ba-f28fab4b7394 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:42.134906 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-559e6a56-5763-4687-a9ba-f28fab4b7394 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:42.140478 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-559e6a56-5763-4687-a9ba-f28fab4b7394 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:42.140974 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-559e6a56-5763-4687-a9ba-f28fab4b7394 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:42.142542 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-559e6a56-5763-4687-a9ba-f28fab4b7394 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:42.142963 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-559e6a56-5763-4687-a9ba-f28fab4b7394 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:42.238310 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-559e6a56-5763-4687-a9ba-f28fab4b7394 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 37321 microversion: 2.1 time: 0.107420 Dec 15 13:05:42.238877 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 151/269] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:05:42 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 37321 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:05:42.557900 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-180d899a-541b-4e3b-ab6e-5af8d9f1d967 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:42.558842 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-180d899a-541b-4e3b-ab6e-5af8d9f1d967 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:42.566309 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-180d899a-541b-4e3b-ab6e-5af8d9f1d967 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:42.566755 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-180d899a-541b-4e3b-ab6e-5af8d9f1d967 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:42.567527 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-180d899a-541b-4e3b-ab6e-5af8d9f1d967 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:42.567962 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-180d899a-541b-4e3b-ab6e-5af8d9f1d967 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:42.821550 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-180d899a-541b-4e3b-ab6e-5af8d9f1d967 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 36443 microversion: 2.20 time: 0.267207 Dec 15 13:05:42.821784 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 152/270] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:05:42 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 36443 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:05:42.826565 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c6593844-e922-4851-87b5-363efdbbdebb tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:42.827254 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c6593844-e922-4851-87b5-363efdbbdebb tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:42.834531 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c6593844-e922-4851-87b5-363efdbbdebb tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:42.835007 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c6593844-e922-4851-87b5-363efdbbdebb tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:42.835890 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c6593844-e922-4851-87b5-363efdbbdebb tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:42.836416 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c6593844-e922-4851-87b5-363efdbbdebb tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:42.971476 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c6593844-e922-4851-87b5-363efdbbdebb tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:42.978597 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c6593844-e922-4851-87b5-363efdbbdebb tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1318 microversion: 2.1 time: 0.155677 Dec 15 13:05:42.979151 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 153/271] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:42 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:43.134024 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-dfce2571-e74a-4dcd-8e7f-0019e176e6bd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:43.134653 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-dfce2571-e74a-4dcd-8e7f-0019e176e6bd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:43.141083 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dfce2571-e74a-4dcd-8e7f-0019e176e6bd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:43.142230 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dfce2571-e74a-4dcd-8e7f-0019e176e6bd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:43.143014 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dfce2571-e74a-4dcd-8e7f-0019e176e6bd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:43.143451 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dfce2571-e74a-4dcd-8e7f-0019e176e6bd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:43.278915 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-dfce2571-e74a-4dcd-8e7f-0019e176e6bd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:43.286428 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-dfce2571-e74a-4dcd-8e7f-0019e176e6bd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1322 microversion: 2.1 time: 0.155981 Dec 15 13:05:43.286996 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 154/272] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:43 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:05:43.291304 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-3be78e4f-8631-42f1-b429-0b3359672d32 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:43.292197 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-3be78e4f-8631-42f1-b429-0b3359672d32 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:43.298239 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3be78e4f-8631-42f1-b429-0b3359672d32 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:43.298685 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3be78e4f-8631-42f1-b429-0b3359672d32 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:43.299454 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3be78e4f-8631-42f1-b429-0b3359672d32 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:43.299885 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3be78e4f-8631-42f1-b429-0b3359672d32 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:43.403676 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-3be78e4f-8631-42f1-b429-0b3359672d32 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 37888 microversion: 2.1 time: 0.115357 Dec 15 13:05:43.404218 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 155/273] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:05:43 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 37888 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:05:43.833362 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-fc959a0e-c7a7-41ab-9a8a-f126c979871e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:43.834398 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-fc959a0e-c7a7-41ab-9a8a-f126c979871e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:43.841271 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fc959a0e-c7a7-41ab-9a8a-f126c979871e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:43.841719 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fc959a0e-c7a7-41ab-9a8a-f126c979871e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:43.842523 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fc959a0e-c7a7-41ab-9a8a-f126c979871e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:43.842959 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fc959a0e-c7a7-41ab-9a8a-f126c979871e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:43.927189 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-fc959a0e-c7a7-41ab-9a8a-f126c979871e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 36982 microversion: 2.20 time: 0.097643 Dec 15 13:05:43.927750 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 156/274] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:05:43 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 36982 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:05:43.995530 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a16e44ed-e79e-41d9-8417-43c19934db1f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:43.996309 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a16e44ed-e79e-41d9-8417-43c19934db1f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:44.003262 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a16e44ed-e79e-41d9-8417-43c19934db1f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:44.003769 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a16e44ed-e79e-41d9-8417-43c19934db1f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:44.004658 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a16e44ed-e79e-41d9-8417-43c19934db1f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:44.005094 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a16e44ed-e79e-41d9-8417-43c19934db1f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:44.143071 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a16e44ed-e79e-41d9-8417-43c19934db1f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:44.151183 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a16e44ed-e79e-41d9-8417-43c19934db1f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1318 microversion: 2.1 time: 0.159594 Dec 15 13:05:44.151732 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 157/275] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:43 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:05:44.303092 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7c5dbdc1-2df6-4701-adac-dd3638e4f3ff tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:44.303807 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7c5dbdc1-2df6-4701-adac-dd3638e4f3ff tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:44.309944 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7c5dbdc1-2df6-4701-adac-dd3638e4f3ff tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:44.310498 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7c5dbdc1-2df6-4701-adac-dd3638e4f3ff tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:44.311274 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7c5dbdc1-2df6-4701-adac-dd3638e4f3ff tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:44.311816 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7c5dbdc1-2df6-4701-adac-dd3638e4f3ff tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:44.443761 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-7c5dbdc1-2df6-4701-adac-dd3638e4f3ff tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:44.450983 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7c5dbdc1-2df6-4701-adac-dd3638e4f3ff tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1322 microversion: 2.1 time: 0.151623 Dec 15 13:05:44.451542 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 158/276] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:44 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:05:44.460991 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-597b6aea-3fdb-4e41-9d58-a41f21836a22 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:44.460991 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-597b6aea-3fdb-4e41-9d58-a41f21836a22 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:44.463881 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-597b6aea-3fdb-4e41-9d58-a41f21836a22 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:44.464378 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-597b6aea-3fdb-4e41-9d58-a41f21836a22 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:44.465163 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-597b6aea-3fdb-4e41-9d58-a41f21836a22 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:44.465692 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-597b6aea-3fdb-4e41-9d58-a41f21836a22 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:44.565604 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-597b6aea-3fdb-4e41-9d58-a41f21836a22 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 38102 microversion: 2.1 time: 0.112755 Dec 15 13:05:44.566306 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 159/277] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:05:44 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 38102 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:05:44.940194 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-47be097f-4888-47d2-a2dd-d8c6ffb6511f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:44.941197 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-47be097f-4888-47d2-a2dd-d8c6ffb6511f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:44.954051 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-47be097f-4888-47d2-a2dd-d8c6ffb6511f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:44.954652 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-47be097f-4888-47d2-a2dd-d8c6ffb6511f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:44.955552 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-47be097f-4888-47d2-a2dd-d8c6ffb6511f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:44.956068 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-47be097f-4888-47d2-a2dd-d8c6ffb6511f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:45.054110 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-47be097f-4888-47d2-a2dd-d8c6ffb6511f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 37698 microversion: 2.20 time: 0.118262 Dec 15 13:05:45.055453 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 160/278] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:05:44 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 37698 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:05:45.169309 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4915ad95-436b-4d8b-8986-6676a48806d6 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:45.170450 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4915ad95-436b-4d8b-8986-6676a48806d6 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:45.180822 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4915ad95-436b-4d8b-8986-6676a48806d6 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:45.181349 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4915ad95-436b-4d8b-8986-6676a48806d6 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:45.182494 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4915ad95-436b-4d8b-8986-6676a48806d6 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:45.183764 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4915ad95-436b-4d8b-8986-6676a48806d6 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:45.344992 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4915ad95-436b-4d8b-8986-6676a48806d6 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:45.353054 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4915ad95-436b-4d8b-8986-6676a48806d6 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1318 microversion: 2.1 time: 0.187742 Dec 15 13:05:45.353618 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 161/279] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:45 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:45.468342 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-102ccd90-644e-48b9-9ee2-b3eb6becee1c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:45.468955 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-102ccd90-644e-48b9-9ee2-b3eb6becee1c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:45.475666 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-102ccd90-644e-48b9-9ee2-b3eb6becee1c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:45.476151 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-102ccd90-644e-48b9-9ee2-b3eb6becee1c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:45.476967 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-102ccd90-644e-48b9-9ee2-b3eb6becee1c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:45.477423 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-102ccd90-644e-48b9-9ee2-b3eb6becee1c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:45.690865 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-102ccd90-644e-48b9-9ee2-b3eb6becee1c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:45.699516 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-102ccd90-644e-48b9-9ee2-b3eb6becee1c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1322 microversion: 2.1 time: 0.234738 Dec 15 13:05:45.700074 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 162/280] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:45 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:05:45.705155 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-28e1335f-1961-4e6e-8996-2f3c3091bf26 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:45.707249 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-28e1335f-1961-4e6e-8996-2f3c3091bf26 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:45.714515 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-28e1335f-1961-4e6e-8996-2f3c3091bf26 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:45.714969 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-28e1335f-1961-4e6e-8996-2f3c3091bf26 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:45.715751 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-28e1335f-1961-4e6e-8996-2f3c3091bf26 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:45.716190 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-28e1335f-1961-4e6e-8996-2f3c3091bf26 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:45.814228 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-28e1335f-1961-4e6e-8996-2f3c3091bf26 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 200 len: 38231 microversion: 2.1 time: 0.112848 Dec 15 13:05:45.818539 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 163/281] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:05:45 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 38231 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:05:45.825541 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-feeb6e5b-5170-4568-a607-a2e6c029739b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:45.826228 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-feeb6e5b-5170-4568-a607-a2e6c029739b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:45.833885 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-feeb6e5b-5170-4568-a607-a2e6c029739b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:45.834965 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-feeb6e5b-5170-4568-a607-a2e6c029739b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:45.835506 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-feeb6e5b-5170-4568-a607-a2e6c029739b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:45.836454 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-feeb6e5b-5170-4568-a607-a2e6c029739b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:45.865408 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-feeb6e5b-5170-4568-a607-a2e6c029739b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/ips" status: 200 len: 145 microversion: 2.1 time: 0.044077 Dec 15 13:05:45.866378 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 164/282] 10.222.0.57 () {58 vars in 1247 bytes} [Wed Dec 15 13:05:45 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/ips => generated 145 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:05:46.067123 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-904b40b6-2a72-4578-bcb7-162cc2b61ce4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:46.068038 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-904b40b6-2a72-4578-bcb7-162cc2b61ce4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:46.075824 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-904b40b6-2a72-4578-bcb7-162cc2b61ce4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:46.076282 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-904b40b6-2a72-4578-bcb7-162cc2b61ce4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:46.077230 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-904b40b6-2a72-4578-bcb7-162cc2b61ce4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:46.077659 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-904b40b6-2a72-4578-bcb7-162cc2b61ce4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:46.163762 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-904b40b6-2a72-4578-bcb7-162cc2b61ce4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 38156 microversion: 2.20 time: 0.100756 Dec 15 13:05:46.165671 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 165/283] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:05:46 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 38156 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:05:46.370798 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4c125382-aac5-45f3-a050-0ddb8e1267e2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:46.372228 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4c125382-aac5-45f3-a050-0ddb8e1267e2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:46.382476 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4c125382-aac5-45f3-a050-0ddb8e1267e2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:46.383299 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4c125382-aac5-45f3-a050-0ddb8e1267e2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:46.384317 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4c125382-aac5-45f3-a050-0ddb8e1267e2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:46.384943 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4c125382-aac5-45f3-a050-0ddb8e1267e2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:46.548351 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4c125382-aac5-45f3-a050-0ddb8e1267e2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:46.557214 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4c125382-aac5-45f3-a050-0ddb8e1267e2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1318 microversion: 2.1 time: 0.190768 Dec 15 13:05:46.557927 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 166/284] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:46 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:05:46.716596 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a632c612-3d40-4c4a-b559-bee19a1e6ef2 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:46.717213 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a632c612-3d40-4c4a-b559-bee19a1e6ef2 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:46.725641 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a632c612-3d40-4c4a-b559-bee19a1e6ef2 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:46.726264 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a632c612-3d40-4c4a-b559-bee19a1e6ef2 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:46.727238 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a632c612-3d40-4c4a-b559-bee19a1e6ef2 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:46.727679 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a632c612-3d40-4c4a-b559-bee19a1e6ef2 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:46.891793 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a632c612-3d40-4c4a-b559-bee19a1e6ef2 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:46.899700 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a632c612-3d40-4c4a-b559-bee19a1e6ef2 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1322 microversion: 2.1 time: 0.186887 Dec 15 13:05:46.916312 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 167/285] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:46 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:05:47.176541 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-3dc412dd-9aab-4351-a17e-be835ca0bb4d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:47.177452 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-3dc412dd-9aab-4351-a17e-be835ca0bb4d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:47.184158 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3dc412dd-9aab-4351-a17e-be835ca0bb4d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:47.184602 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3dc412dd-9aab-4351-a17e-be835ca0bb4d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:47.185383 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3dc412dd-9aab-4351-a17e-be835ca0bb4d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:47.185811 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3dc412dd-9aab-4351-a17e-be835ca0bb4d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:47.271337 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-3dc412dd-9aab-4351-a17e-be835ca0bb4d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 38178 microversion: 2.20 time: 0.098931 Dec 15 13:05:47.272429 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 168/286] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:05:47 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 38178 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:05:47.576554 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-588a0b6d-e540-4f62-8576-5ecbfa4e748e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:47.577592 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-588a0b6d-e540-4f62-8576-5ecbfa4e748e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:47.601547 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-588a0b6d-e540-4f62-8576-5ecbfa4e748e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:47.603977 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-588a0b6d-e540-4f62-8576-5ecbfa4e748e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:47.605031 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-588a0b6d-e540-4f62-8576-5ecbfa4e748e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:47.607217 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-588a0b6d-e540-4f62-8576-5ecbfa4e748e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:47.825851 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-588a0b6d-e540-4f62-8576-5ecbfa4e748e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:47.834127 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-588a0b6d-e540-4f62-8576-5ecbfa4e748e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1318 microversion: 2.1 time: 0.262585 Dec 15 13:05:47.834793 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 169/287] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:47 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:47.916538 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-2399119d-4cf3-44c7-8263-cb94d2acb2f6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:47.917141 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-2399119d-4cf3-44c7-8263-cb94d2acb2f6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:47.923929 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2399119d-4cf3-44c7-8263-cb94d2acb2f6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:47.924370 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2399119d-4cf3-44c7-8263-cb94d2acb2f6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:47.925808 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2399119d-4cf3-44c7-8263-cb94d2acb2f6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:47.926278 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2399119d-4cf3-44c7-8263-cb94d2acb2f6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:48.075618 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-2399119d-4cf3-44c7-8263-cb94d2acb2f6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:48.086069 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-2399119d-4cf3-44c7-8263-cb94d2acb2f6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1322 microversion: 2.1 time: 0.172909 Dec 15 13:05:48.086795 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 170/288] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:47 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:05:48.283968 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4c868c9f-0e73-41d4-bdbe-ed40e872c75e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:48.284896 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4c868c9f-0e73-41d4-bdbe-ed40e872c75e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:48.291258 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4c868c9f-0e73-41d4-bdbe-ed40e872c75e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:48.291704 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4c868c9f-0e73-41d4-bdbe-ed40e872c75e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:48.292691 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4c868c9f-0e73-41d4-bdbe-ed40e872c75e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:48.293132 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4c868c9f-0e73-41d4-bdbe-ed40e872c75e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:48.398648 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4c868c9f-0e73-41d4-bdbe-ed40e872c75e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 200 len: 38299 microversion: 2.20 time: 0.118029 Dec 15 13:05:48.399862 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 171/289] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:05:48 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 38299 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:05:48.410632 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-86d69a3c-434b-45ad-af41-9196b7d12e0c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:48.411369 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-86d69a3c-434b-45ad-af41-9196b7d12e0c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:48.418383 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-86d69a3c-434b-45ad-af41-9196b7d12e0c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:48.418943 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-86d69a3c-434b-45ad-af41-9196b7d12e0c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:48.419803 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-86d69a3c-434b-45ad-af41-9196b7d12e0c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:48.420312 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-86d69a3c-434b-45ad-af41-9196b7d12e0c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:48.453113 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-86d69a3c-434b-45ad-af41-9196b7d12e0c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/ips" status: 200 len: 151 microversion: 2.20 time: 0.046668 Dec 15 13:05:48.459474 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 172/290] 10.222.0.57 () {60 vars in 1288 bytes} [Wed Dec 15 13:05:48 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/ips => generated 151 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:05:48.572538 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.network.neutron [None req-360ab06a-c66a-428c-a7b3-56eee852d8e9 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] validate_networks() for [('77daa3e7-bccf-46d5-b95b-c14f96e66d13', None, None, None, None, None)] {{(pid=116097) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:05:48.774627 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-82a64f91-e971-459b-897b-009e4e8b603f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1875cf69-238a-4ec8-ae41-77a9137010c8"}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:48.775613 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-82a64f91-e971-459b-897b-009e4e8b603f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:48.789867 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-82a64f91-e971-459b-897b-009e4e8b603f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:48.791011 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-82a64f91-e971-459b-897b-009e4e8b603f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:48.793551 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-82a64f91-e971-459b-897b-009e4e8b603f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:48.794592 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-82a64f91-e971-459b-897b-009e4e8b603f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:49.204059 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-360ab06a-c66a-428c-a7b3-56eee852d8e9 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Flavor limits 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:05:49.204735 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-360ab06a-c66a-428c-a7b3-56eee852d8e9 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Image limits 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:05:49.205361 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-360ab06a-c66a-428c-a7b3-56eee852d8e9 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Flavor pref 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:05:49.205918 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-360ab06a-c66a-428c-a7b3-56eee852d8e9 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Image pref 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:05:49.206516 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-360ab06a-c66a-428c-a7b3-56eee852d8e9 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:05:49.218892 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-360ab06a-c66a-428c-a7b3-56eee852d8e9 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:49.220424 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-360ab06a-c66a-428c-a7b3-56eee852d8e9 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:49.221718 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-360ab06a-c66a-428c-a7b3-56eee852d8e9 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:49.222472 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-360ab06a-c66a-428c-a7b3-56eee852d8e9 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:49.224376 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-82a64f91-e971-459b-897b-009e4e8b603f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.461244 Dec 15 13:05:49.227011 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 173/291] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Dec 15 13:05:48 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/os-volume_attachments => generated 194 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:05:49.249849 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-fa1ab82c-7e0c-4384-bd67-78761d46a8a8 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:49.257399 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-360ab06a-c66a-428c-a7b3-56eee852d8e9 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Getting quotas for project b46bbc0bed7d4240b988cedfca33d196. Resources: {'instances', 'cores', 'ram'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:05:49.258224 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-fa1ab82c-7e0c-4384-bd67-78761d46a8a8 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:49.272944 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-360ab06a-c66a-428c-a7b3-56eee852d8e9 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Getting quotas for user f5db27c491ee4002854039f9e53f52af and project b46bbc0bed7d4240b988cedfca33d196. Resources: {'instances', 'cores', 'ram'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:05:49.277875 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fa1ab82c-7e0c-4384-bd67-78761d46a8a8 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:49.278460 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fa1ab82c-7e0c-4384-bd67-78761d46a8a8 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:49.279388 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fa1ab82c-7e0c-4384-bd67-78761d46a8a8 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:49.282363 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fa1ab82c-7e0c-4384-bd67-78761d46a8a8 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:49.295044 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-360ab06a-c66a-428c-a7b3-56eee852d8e9 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Going to run 1 instances... {{(pid=116097) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:05:49.300473 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-360ab06a-c66a-428c-a7b3-56eee852d8e9 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: c12aa550-5e0a-4766-a6c6-d4acab7281b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67890983-693f-44ed-bdf3-22321abeab26',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:05:49.391523 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-360ab06a-c66a-428c-a7b3-56eee852d8e9 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.180376 Dec 15 13:05:49.392650 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 119/292] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Dec 15 13:05:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 9183 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:05:49.402623 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-756f709a-97b3-4956-a5d5-e705fe952ea7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:49.404449 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-756f709a-97b3-4956-a5d5-e705fe952ea7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:49.416409 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-756f709a-97b3-4956-a5d5-e705fe952ea7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:49.416864 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-756f709a-97b3-4956-a5d5-e705fe952ea7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:49.417712 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-756f709a-97b3-4956-a5d5-e705fe952ea7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:49.418598 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-756f709a-97b3-4956-a5d5-e705fe952ea7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:49.509274 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-fa1ab82c-7e0c-4384-bd67-78761d46a8a8 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:49.520693 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-fa1ab82c-7e0c-4384-bd67-78761d46a8a8 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1318 microversion: 2.1 time: 0.291068 Dec 15 13:05:49.523145 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 174/293] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:49 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:49.527849 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0628a6e8-b805-4daf-9348-6626952a6e58 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:49.528733 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0628a6e8-b805-4daf-9348-6626952a6e58 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: c12aa550-5e0a-4766-a6c6-d4acab7281b2] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:49.618691 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0628a6e8-b805-4daf-9348-6626952a6e58 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:49.632170 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-0628a6e8-b805-4daf-9348-6626952a6e58 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2" status: 200 len: 1214 microversion: 2.1 time: 0.105748 Dec 15 13:05:49.641741 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 175/294] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:49 2021] GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2 => generated 1214 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:49.717390 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-756f709a-97b3-4956-a5d5-e705fe952ea7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:49.726197 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-756f709a-97b3-4956-a5d5-e705fe952ea7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1322 microversion: 2.1 time: 0.331809 Dec 15 13:05:49.726971 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 120/295] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:49 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1322 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:50.538726 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ecf4563f-c503-4773-8d9b-99b10e52e777 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:50.539942 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ecf4563f-c503-4773-8d9b-99b10e52e777 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:50.551070 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ecf4563f-c503-4773-8d9b-99b10e52e777 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:50.551561 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ecf4563f-c503-4773-8d9b-99b10e52e777 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:50.552328 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ecf4563f-c503-4773-8d9b-99b10e52e777 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:50.552966 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ecf4563f-c503-4773-8d9b-99b10e52e777 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:50.649066 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-87a45112-54d3-4c34-9e02-f65dce15ca9a tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:50.649980 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-87a45112-54d3-4c34-9e02-f65dce15ca9a tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: c12aa550-5e0a-4766-a6c6-d4acab7281b2] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:50.657545 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-87a45112-54d3-4c34-9e02-f65dce15ca9a tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:50.658001 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-87a45112-54d3-4c34-9e02-f65dce15ca9a tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:50.658846 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-87a45112-54d3-4c34-9e02-f65dce15ca9a tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:50.660198 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-87a45112-54d3-4c34-9e02-f65dce15ca9a tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:50.718830 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ecf4563f-c503-4773-8d9b-99b10e52e777 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:50.727699 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ecf4563f-c503-4773-8d9b-99b10e52e777 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1318 microversion: 2.1 time: 0.192688 Dec 15 13:05:50.728554 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 176/296] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:50 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:50.738293 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-87a45112-54d3-4c34-9e02-f65dce15ca9a tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:50.741791 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-87a45112-54d3-4c34-9e02-f65dce15ca9a tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2" status: 200 len: 1266 microversion: 2.1 time: 0.096458 Dec 15 13:05:50.742405 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 121/297] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:50 2021] GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2 => generated 1266 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:05:50.743306 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-99e9467e-9c8c-4b8e-9a24-c17b69e3e3bd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:50.743908 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-99e9467e-9c8c-4b8e-9a24-c17b69e3e3bd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:50.749845 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-99e9467e-9c8c-4b8e-9a24-c17b69e3e3bd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:50.750987 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-99e9467e-9c8c-4b8e-9a24-c17b69e3e3bd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:50.751783 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-99e9467e-9c8c-4b8e-9a24-c17b69e3e3bd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:50.752214 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-99e9467e-9c8c-4b8e-9a24-c17b69e3e3bd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:50.900053 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-99e9467e-9c8c-4b8e-9a24-c17b69e3e3bd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:50.909465 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-99e9467e-9c8c-4b8e-9a24-c17b69e3e3bd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1322 microversion: 2.1 time: 0.169697 Dec 15 13:05:50.910355 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 177/298] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:50 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:51.106873 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-f1d03dd9-b6f4-4d7c-a87a-1d34dbd653f0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:51.108288 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-f1d03dd9-b6f4-4d7c-a87a-1d34dbd653f0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:51.116696 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f1d03dd9-b6f4-4d7c-a87a-1d34dbd653f0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:51.117592 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f1d03dd9-b6f4-4d7c-a87a-1d34dbd653f0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:51.118548 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f1d03dd9-b6f4-4d7c-a87a-1d34dbd653f0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:51.119108 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f1d03dd9-b6f4-4d7c-a87a-1d34dbd653f0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:51.161658 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.objects.instance [None req-f1d03dd9-b6f4-4d7c-a87a-1d34dbd653f0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lazy-loading 'flavor' on Instance uuid 703b5e88-39f0-436c-ac5a-f1701ec4d7c9 {{(pid=116097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:05:51.469408 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-cf18439c-f6da-478f-b049-e8cfd1d62a0e req-2b236c1d-521a-4a59-81f4-4c9524e9f694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51ca60f9-e96a-440a-83dc-000777505c22", "name": "network-vif-plugged", "status": "completed", "tag": "ce8f94af-f208-4b78-8ade-7227976a0dfd"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:51.471285 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:05:51.471285 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:05:51.486169 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-cf18439c-f6da-478f-b049-e8cfd1d62a0e req-2b236c1d-521a-4a59-81f4-4c9524e9f694 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:51.490359 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-cf18439c-f6da-478f-b049-e8cfd1d62a0e req-2b236c1d-521a-4a59-81f4-4c9524e9f694 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:51.514878 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-cf18439c-f6da-478f-b049-e8cfd1d62a0e req-2b236c1d-521a-4a59-81f4-4c9524e9f694 service nova] Creating event network-vif-plugged:ce8f94af-f208-4b78-8ade-7227976a0dfd for instance 51ca60f9-e96a-440a-83dc-000777505c22 on hv-cinder-81322 Dec 15 13:05:51.527702 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-cf18439c-f6da-478f-b049-e8cfd1d62a0e req-2b236c1d-521a-4a59-81f4-4c9524e9f694 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060676 Dec 15 13:05:51.530214 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 178/299] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:05:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:05:51.602688 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-f1d03dd9-b6f4-4d7c-a87a-1d34dbd653f0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 202 len: 0 microversion: 2.20 time: 0.501209 Dec 15 13:05:51.603705 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 122/300] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:05:51 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Dec 15 13:05:51.621589 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5de50b7c-23fd-4594-a650-be0272db9cb0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:51.623113 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5de50b7c-23fd-4594-a650-be0272db9cb0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:51.635271 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5de50b7c-23fd-4594-a650-be0272db9cb0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:51.635704 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5de50b7c-23fd-4594-a650-be0272db9cb0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:51.636670 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5de50b7c-23fd-4594-a650-be0272db9cb0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:51.637269 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5de50b7c-23fd-4594-a650-be0272db9cb0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:51.754860 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-0539a744-e44d-439d-80d3-59bb9073a113 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:51.756964 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-0539a744-e44d-439d-80d3-59bb9073a113 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:51.774364 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0539a744-e44d-439d-80d3-59bb9073a113 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:51.776704 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0539a744-e44d-439d-80d3-59bb9073a113 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:51.777633 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0539a744-e44d-439d-80d3-59bb9073a113 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:51.779751 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0539a744-e44d-439d-80d3-59bb9073a113 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:51.833616 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5de50b7c-23fd-4594-a650-be0272db9cb0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:51.850516 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5de50b7c-23fd-4594-a650-be0272db9cb0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:51.853021 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5de50b7c-23fd-4594-a650-be0272db9cb0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:51.854482 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5de50b7c-23fd-4594-a650-be0272db9cb0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1722 microversion: 2.20 time: 0.245510 Dec 15 13:05:51.855281 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 179/301] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:05:51 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:05:51.860086 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d6bfdf8d-8dc0-45bf-99aa-caff82581f41 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:51.860939 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d6bfdf8d-8dc0-45bf-99aa-caff82581f41 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: c12aa550-5e0a-4766-a6c6-d4acab7281b2] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:51.867614 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d6bfdf8d-8dc0-45bf-99aa-caff82581f41 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:51.868381 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d6bfdf8d-8dc0-45bf-99aa-caff82581f41 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:51.870097 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d6bfdf8d-8dc0-45bf-99aa-caff82581f41 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:51.870771 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d6bfdf8d-8dc0-45bf-99aa-caff82581f41 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:52.030622 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-0539a744-e44d-439d-80d3-59bb9073a113 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:52.041978 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-0539a744-e44d-439d-80d3-59bb9073a113 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1318 microversion: 2.1 time: 0.298413 Dec 15 13:05:52.042835 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 123/302] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:51 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:05:52.057823 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-a7b13ccb-35b8-4d7b-9755-a43161de8dc3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:52.058602 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-a7b13ccb-35b8-4d7b-9755-a43161de8dc3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:52.065394 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a7b13ccb-35b8-4d7b-9755-a43161de8dc3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:52.065963 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a7b13ccb-35b8-4d7b-9755-a43161de8dc3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:52.066873 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a7b13ccb-35b8-4d7b-9755-a43161de8dc3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:52.067406 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a7b13ccb-35b8-4d7b-9755-a43161de8dc3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:52.095352 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d6bfdf8d-8dc0-45bf-99aa-caff82581f41 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:52.108518 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d6bfdf8d-8dc0-45bf-99aa-caff82581f41 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2" status: 200 len: 1314 microversion: 2.1 time: 0.249343 Dec 15 13:05:52.110734 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 180/303] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:51 2021] GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:52.246688 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-a7b13ccb-35b8-4d7b-9755-a43161de8dc3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:52.255943 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-a7b13ccb-35b8-4d7b-9755-a43161de8dc3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1322 microversion: 2.1 time: 0.202029 Dec 15 13:05:52.265245 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 124/304] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:52 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:52.872800 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-af777fdd-e938-4d6b-aafb-030df31e2034 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:52.873407 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-af777fdd-e938-4d6b-aafb-030df31e2034 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:52.880478 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-af777fdd-e938-4d6b-aafb-030df31e2034 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:52.880933 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-af777fdd-e938-4d6b-aafb-030df31e2034 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:52.881722 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-af777fdd-e938-4d6b-aafb-030df31e2034 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:52.882364 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-af777fdd-e938-4d6b-aafb-030df31e2034 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:53.036879 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-ce250300-8fba-42ee-aa21-c9e1d19fd8e8 req-9cab4573-b9e5-4198-9fd1-c0171600dff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c12aa550-5e0a-4766-a6c6-d4acab7281b2", "tag": "7f82aa8d-7466-43ba-8f47-e9dc62d74365"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:53.038662 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:05:53.038662 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:05:53.055572 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-ce250300-8fba-42ee-aa21-c9e1d19fd8e8 req-9cab4573-b9e5-4198-9fd1-c0171600dff4 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:53.056181 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-ce250300-8fba-42ee-aa21-c9e1d19fd8e8 req-9cab4573-b9e5-4198-9fd1-c0171600dff4 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:53.072244 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-ce250300-8fba-42ee-aa21-c9e1d19fd8e8 req-9cab4573-b9e5-4198-9fd1-c0171600dff4 service nova] Creating event network-changed:7f82aa8d-7466-43ba-8f47-e9dc62d74365 for instance c12aa550-5e0a-4766-a6c6-d4acab7281b2 on hv-cinder-81322 Dec 15 13:05:53.077395 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-ce250300-8fba-42ee-aa21-c9e1d19fd8e8 req-9cab4573-b9e5-4198-9fd1-c0171600dff4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045762 Dec 15 13:05:53.077960 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-af777fdd-e938-4d6b-aafb-030df31e2034 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:53.079071 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 125/305] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:05:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:05:53.084295 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-30bb3914-9f47-4dfc-a283-297b6ae99278 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:53.085636 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-30bb3914-9f47-4dfc-a283-297b6ae99278 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:53.093003 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-30bb3914-9f47-4dfc-a283-297b6ae99278 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:53.093778 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-30bb3914-9f47-4dfc-a283-297b6ae99278 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:53.095344 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-30bb3914-9f47-4dfc-a283-297b6ae99278 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:53.096393 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-30bb3914-9f47-4dfc-a283-297b6ae99278 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:53.118015 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-af777fdd-e938-4d6b-aafb-030df31e2034 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:53.123409 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-af777fdd-e938-4d6b-aafb-030df31e2034 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:53.124609 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-af777fdd-e938-4d6b-aafb-030df31e2034 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1722 microversion: 2.20 time: 0.255478 Dec 15 13:05:53.133175 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 181/306] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:05:52 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:05:53.142364 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4fb6d9d7-38af-410c-a538-7e35ebfa61ad tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:53.143052 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4fb6d9d7-38af-410c-a538-7e35ebfa61ad tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: c12aa550-5e0a-4766-a6c6-d4acab7281b2] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:53.151784 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4fb6d9d7-38af-410c-a538-7e35ebfa61ad tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:53.152329 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4fb6d9d7-38af-410c-a538-7e35ebfa61ad tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:53.153198 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4fb6d9d7-38af-410c-a538-7e35ebfa61ad tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:53.153722 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4fb6d9d7-38af-410c-a538-7e35ebfa61ad tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:53.311824 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4fb6d9d7-38af-410c-a538-7e35ebfa61ad tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:53.324153 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4fb6d9d7-38af-410c-a538-7e35ebfa61ad tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2" status: 200 len: 1314 microversion: 2.1 time: 0.189827 Dec 15 13:05:53.324732 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 182/307] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:53 2021] GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:53.336355 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f7c94ae7-7567-4787-b55f-57fe38092592 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:53.342172 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f7c94ae7-7567-4787-b55f-57fe38092592 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:53.352173 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f7c94ae7-7567-4787-b55f-57fe38092592 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:53.352849 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f7c94ae7-7567-4787-b55f-57fe38092592 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:53.353638 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f7c94ae7-7567-4787-b55f-57fe38092592 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:53.354251 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f7c94ae7-7567-4787-b55f-57fe38092592 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:53.402604 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-30bb3914-9f47-4dfc-a283-297b6ae99278 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:53.411189 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-30bb3914-9f47-4dfc-a283-297b6ae99278 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1318 microversion: 2.1 time: 0.330691 Dec 15 13:05:53.423608 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 126/308] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:53 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:53.546521 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f7c94ae7-7567-4787-b55f-57fe38092592 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:53.554816 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f7c94ae7-7567-4787-b55f-57fe38092592 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1322 microversion: 2.1 time: 0.229080 Dec 15 13:05:53.566633 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 183/309] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:53 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:54.147799 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-766b9f80-7bc7-4af8-91cb-50a2b138d7be tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:54.153315 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-766b9f80-7bc7-4af8-91cb-50a2b138d7be tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:54.165182 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-766b9f80-7bc7-4af8-91cb-50a2b138d7be tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:54.176024 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-766b9f80-7bc7-4af8-91cb-50a2b138d7be tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:54.178112 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-766b9f80-7bc7-4af8-91cb-50a2b138d7be tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:54.178821 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-766b9f80-7bc7-4af8-91cb-50a2b138d7be tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:54.341126 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-14d158f2-12ab-44f1-8a77-f4c3c61db9e7 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:54.342177 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-14d158f2-12ab-44f1-8a77-f4c3c61db9e7 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: c12aa550-5e0a-4766-a6c6-d4acab7281b2] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:54.365111 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-14d158f2-12ab-44f1-8a77-f4c3c61db9e7 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:54.365561 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-14d158f2-12ab-44f1-8a77-f4c3c61db9e7 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:54.366598 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-14d158f2-12ab-44f1-8a77-f4c3c61db9e7 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:54.368739 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-14d158f2-12ab-44f1-8a77-f4c3c61db9e7 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:54.464256 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-766b9f80-7bc7-4af8-91cb-50a2b138d7be tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:54.473568 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-766b9f80-7bc7-4af8-91cb-50a2b138d7be tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:54.475191 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-766b9f80-7bc7-4af8-91cb-50a2b138d7be tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:54.476886 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-766b9f80-7bc7-4af8-91cb-50a2b138d7be tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1722 microversion: 2.20 time: 0.337351 Dec 15 13:05:54.497842 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 127/310] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:05:54 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1722 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:05:54.503749 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-1301130b-6628-4df6-b99c-c507fcf67081 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:54.504805 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-1301130b-6628-4df6-b99c-c507fcf67081 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:54.512504 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1301130b-6628-4df6-b99c-c507fcf67081 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:54.512958 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1301130b-6628-4df6-b99c-c507fcf67081 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:54.513835 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1301130b-6628-4df6-b99c-c507fcf67081 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:54.514384 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1301130b-6628-4df6-b99c-c507fcf67081 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:54.568262 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-14d158f2-12ab-44f1-8a77-f4c3c61db9e7 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:54.583810 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-14d158f2-12ab-44f1-8a77-f4c3c61db9e7 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2" status: 200 len: 1314 microversion: 2.1 time: 0.246665 Dec 15 13:05:54.584501 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 184/311] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:54 2021] GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:05:54.589686 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b5cefb08-7b37-498c-a0a0-f55ba01f547d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:54.590577 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b5cefb08-7b37-498c-a0a0-f55ba01f547d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:54.597873 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b5cefb08-7b37-498c-a0a0-f55ba01f547d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:54.598533 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b5cefb08-7b37-498c-a0a0-f55ba01f547d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:54.599328 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b5cefb08-7b37-498c-a0a0-f55ba01f547d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:54.599755 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b5cefb08-7b37-498c-a0a0-f55ba01f547d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:54.719863 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-1301130b-6628-4df6-b99c-c507fcf67081 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:54.738186 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-1301130b-6628-4df6-b99c-c507fcf67081 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1318 microversion: 2.1 time: 0.238567 Dec 15 13:05:54.738774 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 128/312] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:54 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:54.777284 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b5cefb08-7b37-498c-a0a0-f55ba01f547d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:54.786453 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b5cefb08-7b37-498c-a0a0-f55ba01f547d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1515 microversion: 2.1 time: 0.200613 Dec 15 13:05:54.787341 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 185/313] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:54 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1515 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:54.804094 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-c97c8764-8e94-42bb-a409-f346c345e0fb tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:54.805096 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-c97c8764-8e94-42bb-a409-f346c345e0fb tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:54.811540 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c97c8764-8e94-42bb-a409-f346c345e0fb tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:54.812200 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c97c8764-8e94-42bb-a409-f346c345e0fb tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:54.813462 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c97c8764-8e94-42bb-a409-f346c345e0fb tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:54.813982 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c97c8764-8e94-42bb-a409-f346c345e0fb tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:54.837700 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.objects.instance [None req-c97c8764-8e94-42bb-a409-f346c345e0fb tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lazy-loading 'flavor' on Instance uuid 51ca60f9-e96a-440a-83dc-000777505c22 {{(pid=116097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:05:54.919889 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-c97c8764-8e94-42bb-a409-f346c345e0fb tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "POST /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22/action" status: 200 len: 32 microversion: 2.1 time: 0.120411 Dec 15 13:05:54.920778 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 129/314] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:05:54 2021] POST /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22/action => generated 32 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:05:54.929612 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-79459bc7-80c7-45f9-a43a-b2f1e2c2d60a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:54.930268 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-79459bc7-80c7-45f9-a43a-b2f1e2c2d60a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:54.936344 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-79459bc7-80c7-45f9-a43a-b2f1e2c2d60a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:54.938181 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-79459bc7-80c7-45f9-a43a-b2f1e2c2d60a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:54.938316 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-79459bc7-80c7-45f9-a43a-b2f1e2c2d60a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:54.939987 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-79459bc7-80c7-45f9-a43a-b2f1e2c2d60a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:55.084321 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-79459bc7-80c7-45f9-a43a-b2f1e2c2d60a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:55.092313 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-79459bc7-80c7-45f9-a43a-b2f1e2c2d60a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1521 microversion: 2.1 time: 0.166454 Dec 15 13:05:55.092883 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 186/315] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:54 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:55.349234 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-fb8569fe-09ad-4845-a5be-b7f6e5688c18 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Action: 'create', calling method: .version_select at 0x7faf183a2940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-98634662"}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:55.363245 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-fb8569fe-09ad-4845-a5be-b7f6e5688c18 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Getting quotas for project c78a2fc93eea4d85bd4d547d653dc2b0. Resources: {'key_pairs'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:05:55.367243 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-fb8569fe-09ad-4845-a5be-b7f6e5688c18 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Getting quotas for user dcc76cb4eb2843c9af7299c422400125 and project c78a2fc93eea4d85bd4d547d653dc2b0. Resources: {'key_pairs'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:05:55.505414 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ab1d8cff-4357-4e3d-9c01-b4d7fc908615 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:55.506007 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ab1d8cff-4357-4e3d-9c01-b4d7fc908615 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:55.512283 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ab1d8cff-4357-4e3d-9c01-b4d7fc908615 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:55.512729 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ab1d8cff-4357-4e3d-9c01-b4d7fc908615 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:55.513546 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ab1d8cff-4357-4e3d-9c01-b4d7fc908615 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:55.513976 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ab1d8cff-4357-4e3d-9c01-b4d7fc908615 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:55.629232 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-fb8569fe-09ad-4845-a5be-b7f6e5688c18 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Getting quotas for project c78a2fc93eea4d85bd4d547d653dc2b0. Resources: {'key_pairs'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:05:55.633333 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-fb8569fe-09ad-4845-a5be-b7f6e5688c18 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Getting quotas for user dcc76cb4eb2843c9af7299c422400125 and project c78a2fc93eea4d85bd4d547d653dc2b0. Resources: {'key_pairs'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:05:55.648487 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-fb8569fe-09ad-4845-a5be-b7f6e5688c18 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.304378 Dec 15 13:05:55.649629 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 130/316] 10.222.0.57 () {60 vars in 1157 bytes} [Wed Dec 15 13:05:55 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:05:55.654198 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-9ce32c89-bbb7-42c4-9bbd-5a760bd41fe7 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:55.655104 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-9ce32c89-bbb7-42c4-9bbd-5a760bd41fe7 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: c12aa550-5e0a-4766-a6c6-d4acab7281b2] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:55.669020 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ab1d8cff-4357-4e3d-9c01-b4d7fc908615 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:55.671024 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9ce32c89-bbb7-42c4-9bbd-5a760bd41fe7 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:55.671482 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9ce32c89-bbb7-42c4-9bbd-5a760bd41fe7 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:55.672305 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9ce32c89-bbb7-42c4-9bbd-5a760bd41fe7 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:55.672897 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9ce32c89-bbb7-42c4-9bbd-5a760bd41fe7 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:55.676976 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ab1d8cff-4357-4e3d-9c01-b4d7fc908615 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:55.678488 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ab1d8cff-4357-4e3d-9c01-b4d7fc908615 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:55.679637 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ab1d8cff-4357-4e3d-9c01-b4d7fc908615 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1722 microversion: 2.20 time: 0.178213 Dec 15 13:05:55.684871 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 187/317] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:05:55 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:05:55.714284 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-58e80d2d-39c4-4e04-9deb-9ccd1409da6c tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-175006635", "imageRef": "de3f2c6a-ea7e-4bca-b02a-4bfc62c3e991", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-98634662", "networks": [{"uuid": "a1a0a659-daed-42cd-8cb8-30e6ed7157df"}]}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:55.764699 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.network.neutron [None req-58e80d2d-39c4-4e04-9deb-9ccd1409da6c tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] validate_networks() for [('a1a0a659-daed-42cd-8cb8-30e6ed7157df', None, None, None, None, None)] {{(pid=116098) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:05:55.842220 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-9ce32c89-bbb7-42c4-9bbd-5a760bd41fe7 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:55.852568 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-9ce32c89-bbb7-42c4-9bbd-5a760bd41fe7 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2" status: 200 len: 1314 microversion: 2.1 time: 0.201765 Dec 15 13:05:55.853135 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 131/318] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:55 2021] GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:55.857856 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-df2ce042-7647-49ee-8c2e-9c0da63c834f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:55.858657 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-df2ce042-7647-49ee-8c2e-9c0da63c834f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:55.865098 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-df2ce042-7647-49ee-8c2e-9c0da63c834f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:55.865672 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-df2ce042-7647-49ee-8c2e-9c0da63c834f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:55.866480 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-df2ce042-7647-49ee-8c2e-9c0da63c834f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:55.867099 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-df2ce042-7647-49ee-8c2e-9c0da63c834f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:55.997519 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-df2ce042-7647-49ee-8c2e-9c0da63c834f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:56.004858 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-df2ce042-7647-49ee-8c2e-9c0da63c834f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1318 microversion: 2.1 time: 0.150625 Dec 15 13:05:56.005423 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 132/319] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:55 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:56.109568 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-3edc5b9e-bfe9-4ee1-b91b-9eacd43a2fc5 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:56.110200 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-3edc5b9e-bfe9-4ee1-b91b-9eacd43a2fc5 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:56.115893 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3edc5b9e-bfe9-4ee1-b91b-9eacd43a2fc5 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:56.116347 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3edc5b9e-bfe9-4ee1-b91b-9eacd43a2fc5 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:56.117134 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3edc5b9e-bfe9-4ee1-b91b-9eacd43a2fc5 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:56.117577 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3edc5b9e-bfe9-4ee1-b91b-9eacd43a2fc5 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:56.146433 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-58e80d2d-39c4-4e04-9deb-9ccd1409da6c tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Flavor limits 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:05:56.146860 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-58e80d2d-39c4-4e04-9deb-9ccd1409da6c tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Image limits 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:05:56.147337 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-58e80d2d-39c4-4e04-9deb-9ccd1409da6c tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Flavor pref 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:05:56.147751 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-58e80d2d-39c4-4e04-9deb-9ccd1409da6c tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Image pref 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:05:56.148160 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-58e80d2d-39c4-4e04-9deb-9ccd1409da6c tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:05:56.157396 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-58e80d2d-39c4-4e04-9deb-9ccd1409da6c tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:56.157845 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-58e80d2d-39c4-4e04-9deb-9ccd1409da6c tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:56.158699 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-58e80d2d-39c4-4e04-9deb-9ccd1409da6c tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:56.159137 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-58e80d2d-39c4-4e04-9deb-9ccd1409da6c tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:56.175491 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-58e80d2d-39c4-4e04-9deb-9ccd1409da6c tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Getting quotas for project c78a2fc93eea4d85bd4d547d653dc2b0. Resources: {'instances', 'cores', 'ram'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:05:56.179478 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-58e80d2d-39c4-4e04-9deb-9ccd1409da6c tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Getting quotas for user dcc76cb4eb2843c9af7299c422400125 and project c78a2fc93eea4d85bd4d547d653dc2b0. Resources: {'instances', 'cores', 'ram'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:05:56.190890 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-58e80d2d-39c4-4e04-9deb-9ccd1409da6c tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Going to run 1 instances... {{(pid=116098) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:05:56.193176 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-58e80d2d-39c4-4e04-9deb-9ccd1409da6c tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de3f2c6a-ea7e-4bca-b02a-4bfc62c3e991',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:05:56.240189 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-58e80d2d-39c4-4e04-9deb-9ccd1409da6c tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529382 Dec 15 13:05:56.241003 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 188/320] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Dec 15 13:05:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 13:05:56.244870 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-3edc5b9e-bfe9-4ee1-b91b-9eacd43a2fc5 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:56.250294 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c2b056ce-48ba-4aca-8845-6eff5ea5d596 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:56.250820 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c2b056ce-48ba-4aca-8845-6eff5ea5d596 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:56.252968 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-3edc5b9e-bfe9-4ee1-b91b-9eacd43a2fc5 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1521 microversion: 2.1 time: 0.146888 Dec 15 13:05:56.254179 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 133/321] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:56 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:05:56.302506 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c2b056ce-48ba-4aca-8845-6eff5ea5d596 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:56.309364 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c2b056ce-48ba-4aca-8845-6eff5ea5d596 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1256 microversion: 2.1 time: 0.062531 Dec 15 13:05:56.310113 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 189/322] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:56 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1256 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:56.698741 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-92f384ae-c1cb-4b27-8bc6-0fe08d01665e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:56.699496 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-92f384ae-c1cb-4b27-8bc6-0fe08d01665e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:56.707866 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-92f384ae-c1cb-4b27-8bc6-0fe08d01665e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:56.708452 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-92f384ae-c1cb-4b27-8bc6-0fe08d01665e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:56.709464 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-92f384ae-c1cb-4b27-8bc6-0fe08d01665e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:56.709926 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-92f384ae-c1cb-4b27-8bc6-0fe08d01665e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:56.784524 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-76c838bd-cdd4-46bb-8a9b-041804a87c3b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2bcdb87a-e773-463f-96a4-b5b2ac4256c5", "device": "/dev/sdb"}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:56.786154 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-76c838bd-cdd4-46bb-8a9b-041804a87c3b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: 6d7e8b60-2efb-4376-ab88-65f915ebd89f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:56.793684 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76c838bd-cdd4-46bb-8a9b-041804a87c3b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:56.794160 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76c838bd-cdd4-46bb-8a9b-041804a87c3b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:56.796386 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76c838bd-cdd4-46bb-8a9b-041804a87c3b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:56.797324 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76c838bd-cdd4-46bb-8a9b-041804a87c3b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:56.862591 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-92f384ae-c1cb-4b27-8bc6-0fe08d01665e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:56.872000 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-92f384ae-c1cb-4b27-8bc6-0fe08d01665e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:56.874021 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-92f384ae-c1cb-4b27-8bc6-0fe08d01665e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:56.876384 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-92f384ae-c1cb-4b27-8bc6-0fe08d01665e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1722 microversion: 2.20 time: 0.181083 Dec 15 13:05:56.876969 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 134/323] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:05:56 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:05:56.881212 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-21d2e563-1d55-46d7-9258-bfbfb687abfd tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:56.881733 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-21d2e563-1d55-46d7-9258-bfbfb687abfd tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: c12aa550-5e0a-4766-a6c6-d4acab7281b2] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:56.888170 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-21d2e563-1d55-46d7-9258-bfbfb687abfd tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:56.888611 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-21d2e563-1d55-46d7-9258-bfbfb687abfd tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:56.889410 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-21d2e563-1d55-46d7-9258-bfbfb687abfd tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:56.889837 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-21d2e563-1d55-46d7-9258-bfbfb687abfd tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:57.044613 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-21d2e563-1d55-46d7-9258-bfbfb687abfd tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:57.053303 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-21d2e563-1d55-46d7-9258-bfbfb687abfd tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2" status: 200 len: 1314 microversion: 2.1 time: 0.175345 Dec 15 13:05:57.053965 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 135/324] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:56 2021] GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:57.058188 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-06699cce-38cf-48d5-b7bf-c5a9a500aa83 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:57.058805 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-06699cce-38cf-48d5-b7bf-c5a9a500aa83 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:57.066208 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-06699cce-38cf-48d5-b7bf-c5a9a500aa83 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:57.067198 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-06699cce-38cf-48d5-b7bf-c5a9a500aa83 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:57.068248 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-06699cce-38cf-48d5-b7bf-c5a9a500aa83 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:57.068831 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-06699cce-38cf-48d5-b7bf-c5a9a500aa83 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:57.095150 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-76c838bd-cdd4-46bb-8a9b-041804a87c3b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "POST /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315203 Dec 15 13:05:57.095753 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 190/325] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Dec 15 13:05:56 2021] POST /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:05:57.216387 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-06699cce-38cf-48d5-b7bf-c5a9a500aa83 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:57.224065 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-06699cce-38cf-48d5-b7bf-c5a9a500aa83 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1318 microversion: 2.1 time: 0.169075 Dec 15 13:05:57.224802 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 136/326] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:57 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:57.274239 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9ad56f69-b6b4-41de-a945-d6a5e5ca1c61 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:57.274937 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9ad56f69-b6b4-41de-a945-d6a5e5ca1c61 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:57.282917 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9ad56f69-b6b4-41de-a945-d6a5e5ca1c61 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:57.283503 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9ad56f69-b6b4-41de-a945-d6a5e5ca1c61 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:57.284443 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9ad56f69-b6b4-41de-a945-d6a5e5ca1c61 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:57.284876 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9ad56f69-b6b4-41de-a945-d6a5e5ca1c61 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:57.326398 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-3bc737e0-ed58-4dfc-b72c-8b2a2d23e3e3 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:57.327043 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-3bc737e0-ed58-4dfc-b72c-8b2a2d23e3e3 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:57.335870 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3bc737e0-ed58-4dfc-b72c-8b2a2d23e3e3 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:57.336417 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3bc737e0-ed58-4dfc-b72c-8b2a2d23e3e3 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:57.337387 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3bc737e0-ed58-4dfc-b72c-8b2a2d23e3e3 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:57.337865 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3bc737e0-ed58-4dfc-b72c-8b2a2d23e3e3 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:57.419187 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-3bc737e0-ed58-4dfc-b72c-8b2a2d23e3e3 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:57.429403 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-3bc737e0-ed58-4dfc-b72c-8b2a2d23e3e3 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1308 microversion: 2.1 time: 0.106824 Dec 15 13:05:57.430236 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 137/327] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:57 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1308 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:57.475415 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-9ad56f69-b6b4-41de-a945-d6a5e5ca1c61 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:57.482962 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9ad56f69-b6b4-41de-a945-d6a5e5ca1c61 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1521 microversion: 2.1 time: 0.214286 Dec 15 13:05:57.483850 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 191/328] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:57 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:57.629970 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-3a190b54-dbd4-4883-b16c-62f37ccfe4c1 req-f191836a-de9e-4792-b56f-8bdb465dfa9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5b657b8-e2d6-4365-b369-0accd054202d", "name": "network-vif-plugged", "status": "completed", "tag": "689e019e-fb09-49a1-a85f-3e8039f5d870"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:57.632009 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:05:57.632009 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:05:57.646579 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-3a190b54-dbd4-4883-b16c-62f37ccfe4c1 req-f191836a-de9e-4792-b56f-8bdb465dfa9c service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:57.647024 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-3a190b54-dbd4-4883-b16c-62f37ccfe4c1 req-f191836a-de9e-4792-b56f-8bdb465dfa9c service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:57.669548 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-3a190b54-dbd4-4883-b16c-62f37ccfe4c1 req-f191836a-de9e-4792-b56f-8bdb465dfa9c service nova] Creating event network-vif-plugged:689e019e-fb09-49a1-a85f-3e8039f5d870 for instance e5b657b8-e2d6-4365-b369-0accd054202d on hv-cinder-81322 Dec 15 13:05:57.675224 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-3a190b54-dbd4-4883-b16c-62f37ccfe4c1 req-f191836a-de9e-4792-b56f-8bdb465dfa9c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050504 Dec 15 13:05:57.679338 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 138/329] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:05:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:05:57.896998 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-cc64c813-8977-4a34-9a37-765be6b93485 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:57.898353 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-cc64c813-8977-4a34-9a37-765be6b93485 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:57.906286 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cc64c813-8977-4a34-9a37-765be6b93485 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:57.907041 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cc64c813-8977-4a34-9a37-765be6b93485 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:57.908016 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cc64c813-8977-4a34-9a37-765be6b93485 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:57.908603 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cc64c813-8977-4a34-9a37-765be6b93485 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:58.072275 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-6bd2084d-410d-4c31-b0e8-452d3da999c4 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:58.075107 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-6bd2084d-410d-4c31-b0e8-452d3da999c4 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: c12aa550-5e0a-4766-a6c6-d4acab7281b2] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:58.085139 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6bd2084d-410d-4c31-b0e8-452d3da999c4 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:58.087577 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6bd2084d-410d-4c31-b0e8-452d3da999c4 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:58.090836 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6bd2084d-410d-4c31-b0e8-452d3da999c4 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:58.096214 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6bd2084d-410d-4c31-b0e8-452d3da999c4 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:58.173902 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-cc64c813-8977-4a34-9a37-765be6b93485 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:58.186307 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-cc64c813-8977-4a34-9a37-765be6b93485 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:58.189466 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-cc64c813-8977-4a34-9a37-765be6b93485 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:58.191307 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-cc64c813-8977-4a34-9a37-765be6b93485 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1722 microversion: 2.20 time: 0.298599 Dec 15 13:05:58.192597 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 192/330] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:05:57 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1722 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:05:58.197695 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ea9a3fde-15ad-42eb-84ae-4f836c6cde58 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:58.216229 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ea9a3fde-15ad-42eb-84ae-4f836c6cde58 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:58.216808 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ea9a3fde-15ad-42eb-84ae-4f836c6cde58 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:58.295110 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ea9a3fde-15ad-42eb-84ae-4f836c6cde58 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Going to try to stop instance {{(pid=116098) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 15 13:05:58.366747 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ea9a3fde-15ad-42eb-84ae-4f836c6cde58 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 202 len: 0 microversion: 2.1 time: 0.172576 Dec 15 13:05:58.367948 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 193/331] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:05:58 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:05:58.378773 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-bf4273ca-6e98-4cdd-b7a0-3ea81ea84066 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:58.380285 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-bf4273ca-6e98-4cdd-b7a0-3ea81ea84066 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:58.391029 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bf4273ca-6e98-4cdd-b7a0-3ea81ea84066 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:58.391921 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bf4273ca-6e98-4cdd-b7a0-3ea81ea84066 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:58.393144 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bf4273ca-6e98-4cdd-b7a0-3ea81ea84066 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:58.393788 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bf4273ca-6e98-4cdd-b7a0-3ea81ea84066 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:58.453435 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-6bd2084d-410d-4c31-b0e8-452d3da999c4 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:58.464215 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-6bd2084d-410d-4c31-b0e8-452d3da999c4 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2" status: 200 len: 1314 microversion: 2.1 time: 0.397026 Dec 15 13:05:58.476570 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 139/332] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:58 2021] GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2 => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:05:58.481189 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-ccd85098-a549-46da-b031-96cda8b11b1d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:58.487033 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-ccd85098-a549-46da-b031-96cda8b11b1d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:58.498209 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ccd85098-a549-46da-b031-96cda8b11b1d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:58.501458 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ccd85098-a549-46da-b031-96cda8b11b1d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:58.504154 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ccd85098-a549-46da-b031-96cda8b11b1d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:58.504796 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ccd85098-a549-46da-b031-96cda8b11b1d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:58.600894 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-bf4273ca-6e98-4cdd-b7a0-3ea81ea84066 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:58.608879 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-bf4273ca-6e98-4cdd-b7a0-3ea81ea84066 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1318 microversion: 2.1 time: 0.238886 Dec 15 13:05:58.619713 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 194/333] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:58 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:58.626891 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ce85577e-076b-4572-8e4f-96cb1d092a2a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:58.627721 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ce85577e-076b-4572-8e4f-96cb1d092a2a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:58.635217 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce85577e-076b-4572-8e4f-96cb1d092a2a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:58.635838 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce85577e-076b-4572-8e4f-96cb1d092a2a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:58.636730 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce85577e-076b-4572-8e4f-96cb1d092a2a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:58.637269 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce85577e-076b-4572-8e4f-96cb1d092a2a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:58.794583 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-ccd85098-a549-46da-b031-96cda8b11b1d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:58.821279 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-ccd85098-a549-46da-b031-96cda8b11b1d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.338598 Dec 15 13:05:58.833879 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 140/334] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:58 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:58.839218 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-8bcd596b-860f-464a-b424-29e2db6ea044 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:58.839830 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-8bcd596b-860f-464a-b424-29e2db6ea044 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:58.847098 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8bcd596b-860f-464a-b424-29e2db6ea044 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:58.847551 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8bcd596b-860f-464a-b424-29e2db6ea044 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:58.848349 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8bcd596b-860f-464a-b424-29e2db6ea044 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:58.848788 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8bcd596b-860f-464a-b424-29e2db6ea044 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:58.850042 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ce85577e-076b-4572-8e4f-96cb1d092a2a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:58.858732 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ce85577e-076b-4572-8e4f-96cb1d092a2a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1356 microversion: 2.1 time: 0.237368 Dec 15 13:05:58.866981 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 195/335] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:58 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1356 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:59.030643 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-8bcd596b-860f-464a-b424-29e2db6ea044 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:59.038718 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-8bcd596b-860f-464a-b424-29e2db6ea044 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1521 microversion: 2.1 time: 0.203609 Dec 15 13:05:59.039293 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 141/336] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:58 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:59.208809 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9acd08ac-49bd-43a6-aaa2-42420e4da0f0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:59.209318 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9acd08ac-49bd-43a6-aaa2-42420e4da0f0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:59.215469 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9acd08ac-49bd-43a6-aaa2-42420e4da0f0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:59.215974 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9acd08ac-49bd-43a6-aaa2-42420e4da0f0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:59.216702 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9acd08ac-49bd-43a6-aaa2-42420e4da0f0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:59.217091 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9acd08ac-49bd-43a6-aaa2-42420e4da0f0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:59.365022 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-9acd08ac-49bd-43a6-aaa2-42420e4da0f0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:59.373227 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-9acd08ac-49bd-43a6-aaa2-42420e4da0f0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:59.375553 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-9acd08ac-49bd-43a6-aaa2-42420e4da0f0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:59.376732 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9acd08ac-49bd-43a6-aaa2-42420e4da0f0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1722 microversion: 2.20 time: 0.171689 Dec 15 13:05:59.377389 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 196/337] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:05:59 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:05:59.483673 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-c1699a8a-254c-4166-bbe3-4eef3747a8ba tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:59.485162 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-c1699a8a-254c-4166-bbe3-4eef3747a8ba tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: c12aa550-5e0a-4766-a6c6-d4acab7281b2] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:59.491746 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c1699a8a-254c-4166-bbe3-4eef3747a8ba tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:59.492264 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c1699a8a-254c-4166-bbe3-4eef3747a8ba tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:59.493245 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c1699a8a-254c-4166-bbe3-4eef3747a8ba tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:59.493593 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c1699a8a-254c-4166-bbe3-4eef3747a8ba tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:59.627982 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ef20727b-2856-4d4f-8b2a-ead6f20c2f83 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:59.628909 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ef20727b-2856-4d4f-8b2a-ead6f20c2f83 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:59.629421 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-c1699a8a-254c-4166-bbe3-4eef3747a8ba tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:59.636318 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ef20727b-2856-4d4f-8b2a-ead6f20c2f83 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:59.636807 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ef20727b-2856-4d4f-8b2a-ead6f20c2f83 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:59.637285 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-c1699a8a-254c-4166-bbe3-4eef3747a8ba tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2" status: 200 len: 1314 microversion: 2.1 time: 0.157313 Dec 15 13:05:59.637692 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ef20727b-2856-4d4f-8b2a-ead6f20c2f83 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:59.638175 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ef20727b-2856-4d4f-8b2a-ead6f20c2f83 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:59.648218 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 142/338] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:59 2021] GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:59.781167 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ef20727b-2856-4d4f-8b2a-ead6f20c2f83 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:59.788771 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ef20727b-2856-4d4f-8b2a-ead6f20c2f83 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1318 microversion: 2.1 time: 0.166351 Dec 15 13:05:59.789341 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 197/339] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:59 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:05:59.840565 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-ec54526e-d948-439c-88ac-46add0b2935b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:59.841193 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-ec54526e-d948-439c-88ac-46add0b2935b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:59.847372 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ec54526e-d948-439c-88ac-46add0b2935b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:59.847928 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ec54526e-d948-439c-88ac-46add0b2935b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:59.848639 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ec54526e-d948-439c-88ac-46add0b2935b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:59.849073 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ec54526e-d948-439c-88ac-46add0b2935b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:59.877218 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6b172ac7-a05b-4405-a755-4dc0183c97d0 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:59.877843 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-6b172ac7-a05b-4405-a755-4dc0183c97d0 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:59.884461 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6b172ac7-a05b-4405-a755-4dc0183c97d0 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:59.885027 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6b172ac7-a05b-4405-a755-4dc0183c97d0 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:59.885924 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6b172ac7-a05b-4405-a755-4dc0183c97d0 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:59.886504 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6b172ac7-a05b-4405-a755-4dc0183c97d0 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:59.998291 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-ec54526e-d948-439c-88ac-46add0b2935b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:00.011309 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-ec54526e-d948-439c-88ac-46add0b2935b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.174352 Dec 15 13:06:00.012313 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 143/340] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:59 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:00.037298 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-6b172ac7-a05b-4405-a755-4dc0183c97d0 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:00.044830 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6b172ac7-a05b-4405-a755-4dc0183c97d0 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1356 microversion: 2.1 time: 0.171753 Dec 15 13:06:00.045402 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 198/341] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:59 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1356 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:00.055491 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-1ae2eebc-3e28-4979-bb62-6c265002bf83 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:00.056133 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-1ae2eebc-3e28-4979-bb62-6c265002bf83 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:00.064052 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1ae2eebc-3e28-4979-bb62-6c265002bf83 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:00.064504 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1ae2eebc-3e28-4979-bb62-6c265002bf83 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:00.065304 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1ae2eebc-3e28-4979-bb62-6c265002bf83 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:00.065746 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1ae2eebc-3e28-4979-bb62-6c265002bf83 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:00.198112 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-1ae2eebc-3e28-4979-bb62-6c265002bf83 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:00.205879 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-1ae2eebc-3e28-4979-bb62-6c265002bf83 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1521 microversion: 2.1 time: 0.154225 Dec 15 13:06:00.206674 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 144/342] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:00 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:00.397123 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9686fcde-c0c6-4484-8119-c770ec469f74 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:00.397807 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9686fcde-c0c6-4484-8119-c770ec469f74 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:00.403898 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9686fcde-c0c6-4484-8119-c770ec469f74 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:00.404433 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9686fcde-c0c6-4484-8119-c770ec469f74 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:00.405216 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9686fcde-c0c6-4484-8119-c770ec469f74 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:00.405674 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9686fcde-c0c6-4484-8119-c770ec469f74 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:00.536593 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-9686fcde-c0c6-4484-8119-c770ec469f74 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:00.544653 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-9686fcde-c0c6-4484-8119-c770ec469f74 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:00.546170 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-9686fcde-c0c6-4484-8119-c770ec469f74 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:00.547874 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9686fcde-c0c6-4484-8119-c770ec469f74 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1722 microversion: 2.20 time: 0.154897 Dec 15 13:06:00.550206 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 199/343] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:00 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:06:00.656297 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-fd692167-846d-4aec-93c7-712b5e6ef895 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:00.656918 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-fd692167-846d-4aec-93c7-712b5e6ef895 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: c12aa550-5e0a-4766-a6c6-d4acab7281b2] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:00.663557 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fd692167-846d-4aec-93c7-712b5e6ef895 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:00.664005 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fd692167-846d-4aec-93c7-712b5e6ef895 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:00.664913 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fd692167-846d-4aec-93c7-712b5e6ef895 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:00.665357 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fd692167-846d-4aec-93c7-712b5e6ef895 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:00.806699 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c56ffa99-b525-4a89-85d8-101bbcb26ff3 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:00.807478 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c56ffa99-b525-4a89-85d8-101bbcb26ff3 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:00.812640 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-fd692167-846d-4aec-93c7-712b5e6ef895 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:00.821027 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c56ffa99-b525-4a89-85d8-101bbcb26ff3 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:00.821487 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c56ffa99-b525-4a89-85d8-101bbcb26ff3 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:00.823596 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c56ffa99-b525-4a89-85d8-101bbcb26ff3 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:00.824097 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c56ffa99-b525-4a89-85d8-101bbcb26ff3 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:00.824538 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-fd692167-846d-4aec-93c7-712b5e6ef895 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2" status: 200 len: 1314 microversion: 2.1 time: 0.171943 Dec 15 13:06:00.825114 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 145/344] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:00 2021] GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:00.956733 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c56ffa99-b525-4a89-85d8-101bbcb26ff3 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:00.964245 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c56ffa99-b525-4a89-85d8-101bbcb26ff3 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1318 microversion: 2.1 time: 0.161900 Dec 15 13:06:00.964944 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 200/345] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:00 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:01.029164 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-356c0596-fcb7-4210-addc-4df3b09038e3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:01.030545 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-356c0596-fcb7-4210-addc-4df3b09038e3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:01.038274 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-356c0596-fcb7-4210-addc-4df3b09038e3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:01.038584 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-356c0596-fcb7-4210-addc-4df3b09038e3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:01.039383 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-356c0596-fcb7-4210-addc-4df3b09038e3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:01.040132 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-356c0596-fcb7-4210-addc-4df3b09038e3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:01.061682 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-04479702-a70d-4749-8664-ea9c2c20c880 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:01.062820 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-04479702-a70d-4749-8664-ea9c2c20c880 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:01.068579 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-04479702-a70d-4749-8664-ea9c2c20c880 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:01.069026 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-04479702-a70d-4749-8664-ea9c2c20c880 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:01.069809 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-04479702-a70d-4749-8664-ea9c2c20c880 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:01.078855 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-04479702-a70d-4749-8664-ea9c2c20c880 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:01.177323 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-356c0596-fcb7-4210-addc-4df3b09038e3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:01.185375 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-356c0596-fcb7-4210-addc-4df3b09038e3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.160408 Dec 15 13:06:01.185944 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 146/346] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:01 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:01.222346 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-1b840e67-9051-4206-ade2-feb079910353 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:01.222944 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-1b840e67-9051-4206-ade2-feb079910353 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:01.228994 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1b840e67-9051-4206-ade2-feb079910353 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:01.229180 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1b840e67-9051-4206-ade2-feb079910353 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:01.229871 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1b840e67-9051-4206-ade2-feb079910353 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:01.230333 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1b840e67-9051-4206-ade2-feb079910353 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:01.239968 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-04479702-a70d-4749-8664-ea9c2c20c880 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:01.248730 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-04479702-a70d-4749-8664-ea9c2c20c880 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1356 microversion: 2.1 time: 0.189951 Dec 15 13:06:01.250065 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 201/347] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:01 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1356 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:01.372266 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-1b840e67-9051-4206-ade2-feb079910353 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:01.379510 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-1b840e67-9051-4206-ade2-feb079910353 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1521 microversion: 2.1 time: 0.160826 Dec 15 13:06:01.380055 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 147/348] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:01 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:01.566012 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8d027df4-270c-4176-9acc-665fa68a033c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:01.566615 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8d027df4-270c-4176-9acc-665fa68a033c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:01.572717 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8d027df4-270c-4176-9acc-665fa68a033c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:01.573162 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8d027df4-270c-4176-9acc-665fa68a033c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:01.573982 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8d027df4-270c-4176-9acc-665fa68a033c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:01.574440 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8d027df4-270c-4176-9acc-665fa68a033c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:01.705027 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8d027df4-270c-4176-9acc-665fa68a033c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:01.712999 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8d027df4-270c-4176-9acc-665fa68a033c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:01.714519 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8d027df4-270c-4176-9acc-665fa68a033c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:01.715774 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8d027df4-270c-4176-9acc-665fa68a033c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1722 microversion: 2.20 time: 0.153610 Dec 15 13:06:01.716330 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 202/349] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:01 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:06:01.840729 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-df8fc5dc-4ec6-4ed1-bdc2-d74ded561cdc tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:01.841277 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-df8fc5dc-4ec6-4ed1-bdc2-d74ded561cdc tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: c12aa550-5e0a-4766-a6c6-d4acab7281b2] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:01.847540 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-df8fc5dc-4ec6-4ed1-bdc2-d74ded561cdc tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:01.848012 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-df8fc5dc-4ec6-4ed1-bdc2-d74ded561cdc tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:01.848787 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-df8fc5dc-4ec6-4ed1-bdc2-d74ded561cdc tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:01.849225 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-df8fc5dc-4ec6-4ed1-bdc2-d74ded561cdc tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:01.982190 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-dec4ea3b-71fb-4e47-8cf6-21c0111aed1d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:01.982784 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-dec4ea3b-71fb-4e47-8cf6-21c0111aed1d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:01.983086 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-df8fc5dc-4ec6-4ed1-bdc2-d74ded561cdc tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:01.989708 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dec4ea3b-71fb-4e47-8cf6-21c0111aed1d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:01.990170 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dec4ea3b-71fb-4e47-8cf6-21c0111aed1d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:01.990981 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dec4ea3b-71fb-4e47-8cf6-21c0111aed1d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:01.991405 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dec4ea3b-71fb-4e47-8cf6-21c0111aed1d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:01.993044 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-df8fc5dc-4ec6-4ed1-bdc2-d74ded561cdc tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2" status: 200 len: 1314 microversion: 2.1 time: 0.155940 Dec 15 13:06:02.003110 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 148/350] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:01 2021] GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:02.140019 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-dec4ea3b-71fb-4e47-8cf6-21c0111aed1d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:02.147946 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-dec4ea3b-71fb-4e47-8cf6-21c0111aed1d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1318 microversion: 2.1 time: 0.169374 Dec 15 13:06:02.148600 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 203/351] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:01 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:02.202767 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-ea04ef50-ae41-49ac-ac12-446eade0043d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:02.203365 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-ea04ef50-ae41-49ac-ac12-446eade0043d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:02.209449 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ea04ef50-ae41-49ac-ac12-446eade0043d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:02.209898 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ea04ef50-ae41-49ac-ac12-446eade0043d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:02.211030 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ea04ef50-ae41-49ac-ac12-446eade0043d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:02.211468 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ea04ef50-ae41-49ac-ac12-446eade0043d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:02.265302 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4a4bd076-8446-4a29-8468-da0811eec95f tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:02.265894 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4a4bd076-8446-4a29-8468-da0811eec95f tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:02.273092 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4a4bd076-8446-4a29-8468-da0811eec95f tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:02.273530 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4a4bd076-8446-4a29-8468-da0811eec95f tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:02.275187 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4a4bd076-8446-4a29-8468-da0811eec95f tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:02.275791 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4a4bd076-8446-4a29-8468-da0811eec95f tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:02.353881 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-ea04ef50-ae41-49ac-ac12-446eade0043d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:02.365530 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-ea04ef50-ae41-49ac-ac12-446eade0043d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.166290 Dec 15 13:06:02.366714 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 149/352] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:02 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:02.406470 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-d7529a35-fe53-4e25-a89c-b6f3b7d705d4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:02.408107 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-d7529a35-fe53-4e25-a89c-b6f3b7d705d4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:02.414531 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d7529a35-fe53-4e25-a89c-b6f3b7d705d4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:02.415123 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d7529a35-fe53-4e25-a89c-b6f3b7d705d4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:02.416034 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d7529a35-fe53-4e25-a89c-b6f3b7d705d4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:02.416611 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d7529a35-fe53-4e25-a89c-b6f3b7d705d4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:02.434489 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4a4bd076-8446-4a29-8468-da0811eec95f tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:02.441757 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4a4bd076-8446-4a29-8468-da0811eec95f tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1356 microversion: 2.1 time: 0.180370 Dec 15 13:06:02.442538 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 204/353] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:02 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1356 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:02.557550 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-d7529a35-fe53-4e25-a89c-b6f3b7d705d4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:02.565072 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-d7529a35-fe53-4e25-a89c-b6f3b7d705d4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1521 microversion: 2.1 time: 0.165656 Dec 15 13:06:02.566034 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 150/354] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:02 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:02.733754 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8a3e1761-89d4-4627-a1ca-88483cd0d878 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:02.734535 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8a3e1761-89d4-4627-a1ca-88483cd0d878 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:02.740339 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8a3e1761-89d4-4627-a1ca-88483cd0d878 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:02.740779 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8a3e1761-89d4-4627-a1ca-88483cd0d878 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:02.741548 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8a3e1761-89d4-4627-a1ca-88483cd0d878 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:02.741975 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8a3e1761-89d4-4627-a1ca-88483cd0d878 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:02.879830 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8a3e1761-89d4-4627-a1ca-88483cd0d878 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:02.888295 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8a3e1761-89d4-4627-a1ca-88483cd0d878 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:02.889775 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8a3e1761-89d4-4627-a1ca-88483cd0d878 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:02.890983 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8a3e1761-89d4-4627-a1ca-88483cd0d878 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1722 microversion: 2.20 time: 0.160835 Dec 15 13:06:02.892068 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 205/355] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:02 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:06:03.012568 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-c37c219f-c001-44a0-a10e-688c989db60b tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:03.013373 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-c37c219f-c001-44a0-a10e-688c989db60b tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: c12aa550-5e0a-4766-a6c6-d4acab7281b2] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:03.020488 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c37c219f-c001-44a0-a10e-688c989db60b tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:03.020942 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c37c219f-c001-44a0-a10e-688c989db60b tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:03.021727 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c37c219f-c001-44a0-a10e-688c989db60b tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:03.022182 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c37c219f-c001-44a0-a10e-688c989db60b tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:03.154820 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-c37c219f-c001-44a0-a10e-688c989db60b tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:03.164158 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-c37c219f-c001-44a0-a10e-688c989db60b tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2" status: 200 len: 1314 microversion: 2.1 time: 0.155935 Dec 15 13:06:03.164567 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5b7abfb5-2301-43af-b588-68a0ec596616 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:03.164888 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 151/356] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:03 2021] GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:03.165181 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5b7abfb5-2301-43af-b588-68a0ec596616 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:03.180715 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5b7abfb5-2301-43af-b588-68a0ec596616 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:03.181166 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5b7abfb5-2301-43af-b588-68a0ec596616 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:03.181947 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5b7abfb5-2301-43af-b588-68a0ec596616 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:03.182407 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5b7abfb5-2301-43af-b588-68a0ec596616 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:03.317345 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5b7abfb5-2301-43af-b588-68a0ec596616 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:03.324966 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5b7abfb5-2301-43af-b588-68a0ec596616 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1318 microversion: 2.1 time: 0.163878 Dec 15 13:06:03.325591 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 206/357] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:03 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:03.383699 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-443efa05-6f29-4453-b0df-5e06de0ce4ff tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:03.384499 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-443efa05-6f29-4453-b0df-5e06de0ce4ff tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:03.390611 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-443efa05-6f29-4453-b0df-5e06de0ce4ff tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:03.391065 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-443efa05-6f29-4453-b0df-5e06de0ce4ff tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:03.392443 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-443efa05-6f29-4453-b0df-5e06de0ce4ff tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:03.392885 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-443efa05-6f29-4453-b0df-5e06de0ce4ff tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:03.459549 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a89e7fd8-a4ac-47d4-a274-2f1dbf993044 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:03.460309 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a89e7fd8-a4ac-47d4-a274-2f1dbf993044 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:03.468270 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a89e7fd8-a4ac-47d4-a274-2f1dbf993044 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:03.468270 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a89e7fd8-a4ac-47d4-a274-2f1dbf993044 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:03.468270 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a89e7fd8-a4ac-47d4-a274-2f1dbf993044 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:03.468919 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a89e7fd8-a4ac-47d4-a274-2f1dbf993044 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:03.565056 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-443efa05-6f29-4453-b0df-5e06de0ce4ff tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:03.573667 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-443efa05-6f29-4453-b0df-5e06de0ce4ff tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.193604 Dec 15 13:06:03.574594 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 152/358] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:03 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:03.588405 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-9d0d4ad0-e7fb-4c4d-ac8d-795771f48166 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:03.589260 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-9d0d4ad0-e7fb-4c4d-ac8d-795771f48166 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:03.597871 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9d0d4ad0-e7fb-4c4d-ac8d-795771f48166 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:03.598580 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9d0d4ad0-e7fb-4c4d-ac8d-795771f48166 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:03.599719 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9d0d4ad0-e7fb-4c4d-ac8d-795771f48166 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:03.600302 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9d0d4ad0-e7fb-4c4d-ac8d-795771f48166 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:03.664347 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a89e7fd8-a4ac-47d4-a274-2f1dbf993044 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:03.672019 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a89e7fd8-a4ac-47d4-a274-2f1dbf993044 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1356 microversion: 2.1 time: 0.216537 Dec 15 13:06:03.673375 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 207/359] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:03 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1356 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:03.677443 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-9e9d0c3b-f2be-44ac-9aff-886aa3b5f1ac req-ec5a5ac0-d10c-4694-b2a3-0a6bf240ef48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c12aa550-5e0a-4766-a6c6-d4acab7281b2", "name": "network-vif-plugged", "status": "completed", "tag": "7f82aa8d-7466-43ba-8f47-e9dc62d74365"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:06:03.679163 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:06:03.679163 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:06:03.685616 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-9e9d0c3b-f2be-44ac-9aff-886aa3b5f1ac req-ec5a5ac0-d10c-4694-b2a3-0a6bf240ef48 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:03.686048 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-9e9d0c3b-f2be-44ac-9aff-886aa3b5f1ac req-ec5a5ac0-d10c-4694-b2a3-0a6bf240ef48 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:03.698452 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-9e9d0c3b-f2be-44ac-9aff-886aa3b5f1ac req-ec5a5ac0-d10c-4694-b2a3-0a6bf240ef48 service nova] Creating event network-vif-plugged:7f82aa8d-7466-43ba-8f47-e9dc62d74365 for instance c12aa550-5e0a-4766-a6c6-d4acab7281b2 on hv-cinder-81322 Dec 15 13:06:03.704179 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-9e9d0c3b-f2be-44ac-9aff-886aa3b5f1ac req-ec5a5ac0-d10c-4694-b2a3-0a6bf240ef48 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029767 Dec 15 13:06:03.705000 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 208/360] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:06:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:06:03.756163 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-9d0d4ad0-e7fb-4c4d-ac8d-795771f48166 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:03.763798 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-9d0d4ad0-e7fb-4c4d-ac8d-795771f48166 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1521 microversion: 2.1 time: 0.186205 Dec 15 13:06:03.764496 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 153/361] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:03 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:03.909871 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-3469068a-22c9-43f2-973f-148a95282533 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:03.910902 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-3469068a-22c9-43f2-973f-148a95282533 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:03.917368 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3469068a-22c9-43f2-973f-148a95282533 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:03.917907 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3469068a-22c9-43f2-973f-148a95282533 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:03.918919 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3469068a-22c9-43f2-973f-148a95282533 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:03.919501 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3469068a-22c9-43f2-973f-148a95282533 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:04.057131 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-3469068a-22c9-43f2-973f-148a95282533 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:04.065478 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-3469068a-22c9-43f2-973f-148a95282533 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:04.066986 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-3469068a-22c9-43f2-973f-148a95282533 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:04.068154 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-3469068a-22c9-43f2-973f-148a95282533 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1722 microversion: 2.20 time: 0.162786 Dec 15 13:06:04.068897 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 209/362] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:03 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:06:04.182085 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-fc4e3d6a-923d-4860-aa45-93ac804e49e9 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:04.182733 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-fc4e3d6a-923d-4860-aa45-93ac804e49e9 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: c12aa550-5e0a-4766-a6c6-d4acab7281b2] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:04.189829 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fc4e3d6a-923d-4860-aa45-93ac804e49e9 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:04.190314 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fc4e3d6a-923d-4860-aa45-93ac804e49e9 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:04.191124 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fc4e3d6a-923d-4860-aa45-93ac804e49e9 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:04.191613 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fc4e3d6a-923d-4860-aa45-93ac804e49e9 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:04.345756 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-fc4e3d6a-923d-4860-aa45-93ac804e49e9 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:04.347449 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f10cd2ec-c5ad-4db6-bbe8-a2c0d88303b9 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:04.348063 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f10cd2ec-c5ad-4db6-bbe8-a2c0d88303b9 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:04.352125 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-fc4e3d6a-923d-4860-aa45-93ac804e49e9 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2" status: 200 len: 1314 microversion: 2.1 time: 0.173676 Dec 15 13:06:04.355356 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 154/363] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:04 2021] GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:04.357268 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f10cd2ec-c5ad-4db6-bbe8-a2c0d88303b9 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:04.357873 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f10cd2ec-c5ad-4db6-bbe8-a2c0d88303b9 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:04.358841 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f10cd2ec-c5ad-4db6-bbe8-a2c0d88303b9 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:04.360908 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f10cd2ec-c5ad-4db6-bbe8-a2c0d88303b9 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:04.515644 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f10cd2ec-c5ad-4db6-bbe8-a2c0d88303b9 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:04.525858 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f10cd2ec-c5ad-4db6-bbe8-a2c0d88303b9 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1318 microversion: 2.1 time: 0.185299 Dec 15 13:06:04.525989 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 210/364] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:04 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:04.595239 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-cbd197cc-cfdc-46a6-a68f-01324a4c2a11 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:04.595956 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-cbd197cc-cfdc-46a6-a68f-01324a4c2a11 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:04.613724 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cbd197cc-cfdc-46a6-a68f-01324a4c2a11 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:04.614233 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cbd197cc-cfdc-46a6-a68f-01324a4c2a11 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:04.614949 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cbd197cc-cfdc-46a6-a68f-01324a4c2a11 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:04.615469 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cbd197cc-cfdc-46a6-a68f-01324a4c2a11 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:04.690041 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-601ff585-5c45-4ee2-b3eb-5553d45b1050 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:04.690673 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-601ff585-5c45-4ee2-b3eb-5553d45b1050 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:04.711479 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-601ff585-5c45-4ee2-b3eb-5553d45b1050 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:04.712410 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-601ff585-5c45-4ee2-b3eb-5553d45b1050 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:04.713177 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-601ff585-5c45-4ee2-b3eb-5553d45b1050 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:04.713603 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-601ff585-5c45-4ee2-b3eb-5553d45b1050 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:04.778526 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-cbd197cc-cfdc-46a6-a68f-01324a4c2a11 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:04.786716 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-cbd197cc-cfdc-46a6-a68f-01324a4c2a11 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.198940 Dec 15 13:06:04.787281 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 155/365] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:04 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:04.791590 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-4990c1da-6a41-4eee-9dd5-e8178745953d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:04.792212 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-4990c1da-6a41-4eee-9dd5-e8178745953d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:04.798165 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4990c1da-6a41-4eee-9dd5-e8178745953d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:04.798641 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4990c1da-6a41-4eee-9dd5-e8178745953d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:04.799422 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4990c1da-6a41-4eee-9dd5-e8178745953d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:04.799853 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4990c1da-6a41-4eee-9dd5-e8178745953d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:04.850935 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-601ff585-5c45-4ee2-b3eb-5553d45b1050 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:04.858494 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-601ff585-5c45-4ee2-b3eb-5553d45b1050 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1356 microversion: 2.1 time: 0.173089 Dec 15 13:06:04.859250 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 211/366] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:04 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1356 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:04.955531 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-4990c1da-6a41-4eee-9dd5-e8178745953d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:04.963169 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-4990c1da-6a41-4eee-9dd5-e8178745953d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1521 microversion: 2.1 time: 0.174894 Dec 15 13:06:04.963823 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 156/367] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:04 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:05.086118 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-bd6fc2f0-978a-4597-afa0-72601968b03c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:05.086770 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-bd6fc2f0-978a-4597-afa0-72601968b03c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:05.092661 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bd6fc2f0-978a-4597-afa0-72601968b03c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:05.093107 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bd6fc2f0-978a-4597-afa0-72601968b03c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:05.093870 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bd6fc2f0-978a-4597-afa0-72601968b03c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:05.094332 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bd6fc2f0-978a-4597-afa0-72601968b03c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:05.224192 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-bd6fc2f0-978a-4597-afa0-72601968b03c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:05.231939 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-bd6fc2f0-978a-4597-afa0-72601968b03c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:05.233416 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-bd6fc2f0-978a-4597-afa0-72601968b03c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:05.235302 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-bd6fc2f0-978a-4597-afa0-72601968b03c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1722 microversion: 2.20 time: 0.152232 Dec 15 13:06:05.235919 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 212/368] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:05 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:06:05.370127 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-1b40c5cc-7632-46db-9797-007d7d584279 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:05.370794 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-1b40c5cc-7632-46db-9797-007d7d584279 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: c12aa550-5e0a-4766-a6c6-d4acab7281b2] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:05.377086 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1b40c5cc-7632-46db-9797-007d7d584279 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:05.377539 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1b40c5cc-7632-46db-9797-007d7d584279 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:05.378373 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1b40c5cc-7632-46db-9797-007d7d584279 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:05.378907 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1b40c5cc-7632-46db-9797-007d7d584279 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:05.519635 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-1b40c5cc-7632-46db-9797-007d7d584279 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:05.530538 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-1b40c5cc-7632-46db-9797-007d7d584279 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2" status: 200 len: 1314 microversion: 2.1 time: 0.163936 Dec 15 13:06:05.531115 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 157/369] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:05 2021] GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:05.543264 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1ec6a18e-137f-4760-bde5-dae9914f8b2f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:05.544043 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1ec6a18e-137f-4760-bde5-dae9914f8b2f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:05.551482 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1ec6a18e-137f-4760-bde5-dae9914f8b2f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:05.551932 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1ec6a18e-137f-4760-bde5-dae9914f8b2f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:05.552725 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1ec6a18e-137f-4760-bde5-dae9914f8b2f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:05.553160 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1ec6a18e-137f-4760-bde5-dae9914f8b2f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:05.709493 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1ec6a18e-137f-4760-bde5-dae9914f8b2f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:05.716818 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1ec6a18e-137f-4760-bde5-dae9914f8b2f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1318 microversion: 2.1 time: 0.177416 Dec 15 13:06:05.717321 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 213/370] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:05 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:05.805805 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-d1058653-4481-40f4-b61e-97e1b3b0340b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:05.806737 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-d1058653-4481-40f4-b61e-97e1b3b0340b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:05.813427 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d1058653-4481-40f4-b61e-97e1b3b0340b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:05.813883 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d1058653-4481-40f4-b61e-97e1b3b0340b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:05.815202 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d1058653-4481-40f4-b61e-97e1b3b0340b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:05.815705 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d1058653-4481-40f4-b61e-97e1b3b0340b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:05.878278 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5ad90fd1-9351-4962-a5d3-d386991eb2a9 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:05.879215 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5ad90fd1-9351-4962-a5d3-d386991eb2a9 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:05.885747 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5ad90fd1-9351-4962-a5d3-d386991eb2a9 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:05.886575 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5ad90fd1-9351-4962-a5d3-d386991eb2a9 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:05.887726 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5ad90fd1-9351-4962-a5d3-d386991eb2a9 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:05.888347 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5ad90fd1-9351-4962-a5d3-d386991eb2a9 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:06.031463 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-d1058653-4481-40f4-b61e-97e1b3b0340b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:06.040769 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-d1058653-4481-40f4-b61e-97e1b3b0340b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.238576 Dec 15 13:06:06.051187 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 158/371] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:05 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:06.056456 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-6159d563-a5ce-4af4-b493-6e0dbb68a597 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:06.057062 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-6159d563-a5ce-4af4-b493-6e0dbb68a597 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:06.063163 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6159d563-a5ce-4af4-b493-6e0dbb68a597 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:06.063317 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5ad90fd1-9351-4962-a5d3-d386991eb2a9 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:06.063628 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6159d563-a5ce-4af4-b493-6e0dbb68a597 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:06.064391 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6159d563-a5ce-4af4-b493-6e0dbb68a597 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:06.064824 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6159d563-a5ce-4af4-b493-6e0dbb68a597 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:06.070325 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5ad90fd1-9351-4962-a5d3-d386991eb2a9 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1356 microversion: 2.1 time: 0.198113 Dec 15 13:06:06.070884 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 214/372] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:05 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1356 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:06.203050 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-6159d563-a5ce-4af4-b493-6e0dbb68a597 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:06.210967 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-6159d563-a5ce-4af4-b493-6e0dbb68a597 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1521 microversion: 2.1 time: 0.158651 Dec 15 13:06:06.211523 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 159/373] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:06 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:06.253235 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-98bca3b9-1f31-4e19-ad17-ce7134d4081a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:06.253877 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-98bca3b9-1f31-4e19-ad17-ce7134d4081a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:06.260182 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-98bca3b9-1f31-4e19-ad17-ce7134d4081a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:06.260904 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-98bca3b9-1f31-4e19-ad17-ce7134d4081a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:06.262210 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-98bca3b9-1f31-4e19-ad17-ce7134d4081a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:06.262882 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-98bca3b9-1f31-4e19-ad17-ce7134d4081a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:06.396335 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-98bca3b9-1f31-4e19-ad17-ce7134d4081a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:06.404261 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-98bca3b9-1f31-4e19-ad17-ce7134d4081a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:06.405753 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-98bca3b9-1f31-4e19-ad17-ce7134d4081a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:06.407493 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-98bca3b9-1f31-4e19-ad17-ce7134d4081a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1722 microversion: 2.20 time: 0.158125 Dec 15 13:06:06.408299 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 215/374] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:06 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:06:06.547842 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-9afba8e9-6197-4232-8ac5-4183b6f26645 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:06.548523 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-9afba8e9-6197-4232-8ac5-4183b6f26645 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: c12aa550-5e0a-4766-a6c6-d4acab7281b2] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:06.554885 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9afba8e9-6197-4232-8ac5-4183b6f26645 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:06.555421 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9afba8e9-6197-4232-8ac5-4183b6f26645 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:06.556282 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9afba8e9-6197-4232-8ac5-4183b6f26645 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:06.556720 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9afba8e9-6197-4232-8ac5-4183b6f26645 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:06.690420 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-9afba8e9-6197-4232-8ac5-4183b6f26645 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:06.698307 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-9afba8e9-6197-4232-8ac5-4183b6f26645 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2" status: 200 len: 1314 microversion: 2.1 time: 0.153982 Dec 15 13:06:06.699054 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 160/375] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:06 2021] GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:06.734113 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-da7eb264-b579-439f-98d8-930c56fa6a78 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:06.734785 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-da7eb264-b579-439f-98d8-930c56fa6a78 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:06.741087 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-da7eb264-b579-439f-98d8-930c56fa6a78 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:06.741532 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-da7eb264-b579-439f-98d8-930c56fa6a78 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:06.742418 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-da7eb264-b579-439f-98d8-930c56fa6a78 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:06.742851 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-da7eb264-b579-439f-98d8-930c56fa6a78 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:06.880072 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-da7eb264-b579-439f-98d8-930c56fa6a78 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:06.887678 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-da7eb264-b579-439f-98d8-930c56fa6a78 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1318 microversion: 2.1 time: 0.157488 Dec 15 13:06:06.888239 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 216/376] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:06 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:07.058252 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-e94981d7-538f-4eea-8b0b-d1f885634a36 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:07.058948 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-e94981d7-538f-4eea-8b0b-d1f885634a36 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:07.065578 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e94981d7-538f-4eea-8b0b-d1f885634a36 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:07.066093 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e94981d7-538f-4eea-8b0b-d1f885634a36 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:07.066855 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e94981d7-538f-4eea-8b0b-d1f885634a36 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:07.067344 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e94981d7-538f-4eea-8b0b-d1f885634a36 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:07.087811 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9d4132ba-3dd8-4e2c-8fe1-77d07cd7a251 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:07.088548 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9d4132ba-3dd8-4e2c-8fe1-77d07cd7a251 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:07.094636 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9d4132ba-3dd8-4e2c-8fe1-77d07cd7a251 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:07.095853 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9d4132ba-3dd8-4e2c-8fe1-77d07cd7a251 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:07.096782 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9d4132ba-3dd8-4e2c-8fe1-77d07cd7a251 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:07.097317 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9d4132ba-3dd8-4e2c-8fe1-77d07cd7a251 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:07.212108 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-e94981d7-538f-4eea-8b0b-d1f885634a36 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:07.223120 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-e94981d7-538f-4eea-8b0b-d1f885634a36 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.167450 Dec 15 13:06:07.223864 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 161/377] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:07 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:07.228387 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-0658198c-e583-438a-ac6b-08813f7085cc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:07.229068 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-0658198c-e583-438a-ac6b-08813f7085cc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:07.235395 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0658198c-e583-438a-ac6b-08813f7085cc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:07.235841 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0658198c-e583-438a-ac6b-08813f7085cc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:07.236613 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0658198c-e583-438a-ac6b-08813f7085cc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:07.237044 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0658198c-e583-438a-ac6b-08813f7085cc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:07.237147 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-9d4132ba-3dd8-4e2c-8fe1-77d07cd7a251 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:07.244202 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9d4132ba-3dd8-4e2c-8fe1-77d07cd7a251 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1356 microversion: 2.1 time: 0.160248 Dec 15 13:06:07.244764 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 217/378] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:07 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1356 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:07.370006 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-0658198c-e583-438a-ac6b-08813f7085cc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:07.378297 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-0658198c-e583-438a-ac6b-08813f7085cc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1521 microversion: 2.1 time: 0.153270 Dec 15 13:06:07.378867 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 162/379] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:07 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:07.425201 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-265ca874-86b8-46fb-89a9-148bb57d8ad1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:07.425794 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-265ca874-86b8-46fb-89a9-148bb57d8ad1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:07.431756 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-265ca874-86b8-46fb-89a9-148bb57d8ad1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:07.432202 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-265ca874-86b8-46fb-89a9-148bb57d8ad1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:07.432978 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-265ca874-86b8-46fb-89a9-148bb57d8ad1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:07.433408 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-265ca874-86b8-46fb-89a9-148bb57d8ad1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:07.571513 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-265ca874-86b8-46fb-89a9-148bb57d8ad1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:07.579521 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-265ca874-86b8-46fb-89a9-148bb57d8ad1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:07.581010 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-265ca874-86b8-46fb-89a9-148bb57d8ad1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:07.582230 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-265ca874-86b8-46fb-89a9-148bb57d8ad1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1722 microversion: 2.20 time: 0.161212 Dec 15 13:06:07.582980 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 218/380] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:07 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:06:07.715542 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-8febb9b3-92b7-4a95-b532-674cc645b9fb tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:07.716141 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-8febb9b3-92b7-4a95-b532-674cc645b9fb tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: c12aa550-5e0a-4766-a6c6-d4acab7281b2] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:07.722954 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8febb9b3-92b7-4a95-b532-674cc645b9fb tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:07.723395 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8febb9b3-92b7-4a95-b532-674cc645b9fb tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:07.724165 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8febb9b3-92b7-4a95-b532-674cc645b9fb tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:07.724593 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8febb9b3-92b7-4a95-b532-674cc645b9fb tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:07.861954 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-8febb9b3-92b7-4a95-b532-674cc645b9fb tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:07.869532 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-8febb9b3-92b7-4a95-b532-674cc645b9fb tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2" status: 200 len: 1314 microversion: 2.1 time: 0.157562 Dec 15 13:06:07.870093 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 163/381] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:07 2021] GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:07.904552 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5ac488f2-7b74-4b6b-9eae-279a8df00028 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:07.905156 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5ac488f2-7b74-4b6b-9eae-279a8df00028 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:07.912118 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5ac488f2-7b74-4b6b-9eae-279a8df00028 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:07.912563 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5ac488f2-7b74-4b6b-9eae-279a8df00028 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:07.913348 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5ac488f2-7b74-4b6b-9eae-279a8df00028 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:07.913784 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5ac488f2-7b74-4b6b-9eae-279a8df00028 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:08.054583 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5ac488f2-7b74-4b6b-9eae-279a8df00028 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:08.064185 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5ac488f2-7b74-4b6b-9eae-279a8df00028 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1318 microversion: 2.1 time: 0.163232 Dec 15 13:06:08.065032 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 219/382] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:07 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:08.238951 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-3adbc905-a926-4c94-8761-4d1e8444ad00 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:08.239561 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-3adbc905-a926-4c94-8761-4d1e8444ad00 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:08.245567 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3adbc905-a926-4c94-8761-4d1e8444ad00 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:08.246020 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3adbc905-a926-4c94-8761-4d1e8444ad00 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:08.246840 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3adbc905-a926-4c94-8761-4d1e8444ad00 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:08.247277 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3adbc905-a926-4c94-8761-4d1e8444ad00 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:08.261177 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e95d120d-d41f-4910-aed9-1bbdc3c4429d tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:08.262191 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e95d120d-d41f-4910-aed9-1bbdc3c4429d tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:08.269803 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e95d120d-d41f-4910-aed9-1bbdc3c4429d tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:08.270291 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e95d120d-d41f-4910-aed9-1bbdc3c4429d tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:08.271068 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e95d120d-d41f-4910-aed9-1bbdc3c4429d tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:08.271503 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e95d120d-d41f-4910-aed9-1bbdc3c4429d tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:08.407557 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-3adbc905-a926-4c94-8761-4d1e8444ad00 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:08.416391 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-3adbc905-a926-4c94-8761-4d1e8444ad00 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.180966 Dec 15 13:06:08.417345 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 164/383] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:08 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:08.423451 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-db76bdf3-d2e4-434a-94dc-50b0cc8decd0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:08.424281 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-db76bdf3-d2e4-434a-94dc-50b0cc8decd0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:08.430928 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-db76bdf3-d2e4-434a-94dc-50b0cc8decd0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:08.431376 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-db76bdf3-d2e4-434a-94dc-50b0cc8decd0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:08.432168 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-db76bdf3-d2e4-434a-94dc-50b0cc8decd0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:08.432602 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-db76bdf3-d2e4-434a-94dc-50b0cc8decd0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:08.437208 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e95d120d-d41f-4910-aed9-1bbdc3c4429d tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:08.450046 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e95d120d-d41f-4910-aed9-1bbdc3c4429d tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1356 microversion: 2.1 time: 0.192868 Dec 15 13:06:08.451100 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 220/384] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:08 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1356 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:08.571067 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-db76bdf3-d2e4-434a-94dc-50b0cc8decd0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:08.579667 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-db76bdf3-d2e4-434a-94dc-50b0cc8decd0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1521 microversion: 2.1 time: 0.160880 Dec 15 13:06:08.580241 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 165/385] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:08 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:08.599672 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b71bdb47-0fa0-4e3a-bf33-cd10edb6dfc4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:08.600282 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b71bdb47-0fa0-4e3a-bf33-cd10edb6dfc4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:08.606789 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b71bdb47-0fa0-4e3a-bf33-cd10edb6dfc4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:08.607271 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b71bdb47-0fa0-4e3a-bf33-cd10edb6dfc4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:08.608286 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b71bdb47-0fa0-4e3a-bf33-cd10edb6dfc4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:08.608729 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b71bdb47-0fa0-4e3a-bf33-cd10edb6dfc4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:08.762512 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b71bdb47-0fa0-4e3a-bf33-cd10edb6dfc4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:08.770595 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b71bdb47-0fa0-4e3a-bf33-cd10edb6dfc4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:08.772019 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b71bdb47-0fa0-4e3a-bf33-cd10edb6dfc4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:08.773204 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b71bdb47-0fa0-4e3a-bf33-cd10edb6dfc4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1722 microversion: 2.20 time: 0.177236 Dec 15 13:06:08.773767 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 221/386] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:08 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:06:08.886083 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-dbd14e47-b3f8-499b-a764-c060b3a593f5 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:08.886726 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-dbd14e47-b3f8-499b-a764-c060b3a593f5 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: c12aa550-5e0a-4766-a6c6-d4acab7281b2] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:08.893095 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dbd14e47-b3f8-499b-a764-c060b3a593f5 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:08.893554 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dbd14e47-b3f8-499b-a764-c060b3a593f5 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:08.894677 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dbd14e47-b3f8-499b-a764-c060b3a593f5 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:08.895120 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dbd14e47-b3f8-499b-a764-c060b3a593f5 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:09.038224 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-dbd14e47-b3f8-499b-a764-c060b3a593f5 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:09.045747 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-dbd14e47-b3f8-499b-a764-c060b3a593f5 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2" status: 200 len: 1314 microversion: 2.1 time: 0.163392 Dec 15 13:06:09.046616 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 166/387] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:08 2021] GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:09.081105 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ae4b4835-b27f-4c44-b565-0130a5eaaf47 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:09.081874 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ae4b4835-b27f-4c44-b565-0130a5eaaf47 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:09.088146 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ae4b4835-b27f-4c44-b565-0130a5eaaf47 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:09.088589 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ae4b4835-b27f-4c44-b565-0130a5eaaf47 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:09.089361 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ae4b4835-b27f-4c44-b565-0130a5eaaf47 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:09.089790 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ae4b4835-b27f-4c44-b565-0130a5eaaf47 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:09.223757 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ae4b4835-b27f-4c44-b565-0130a5eaaf47 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:09.232721 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ae4b4835-b27f-4c44-b565-0130a5eaaf47 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1318 microversion: 2.1 time: 0.155628 Dec 15 13:06:09.233378 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 222/388] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:09 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:09.434975 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-77f211ff-f9aa-4bf4-b095-64d4fa67395e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:09.435841 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-77f211ff-f9aa-4bf4-b095-64d4fa67395e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:09.442545 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-77f211ff-f9aa-4bf4-b095-64d4fa67395e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:09.442997 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-77f211ff-f9aa-4bf4-b095-64d4fa67395e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:09.443786 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-77f211ff-f9aa-4bf4-b095-64d4fa67395e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:09.444225 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-77f211ff-f9aa-4bf4-b095-64d4fa67395e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:09.468301 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-cf4d272f-29f9-4771-b01b-ef186fd433f8 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:09.469552 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-cf4d272f-29f9-4771-b01b-ef186fd433f8 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:09.477130 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cf4d272f-29f9-4771-b01b-ef186fd433f8 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:09.477130 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cf4d272f-29f9-4771-b01b-ef186fd433f8 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:09.477130 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cf4d272f-29f9-4771-b01b-ef186fd433f8 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:09.477528 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cf4d272f-29f9-4771-b01b-ef186fd433f8 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:09.589902 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-77f211ff-f9aa-4bf4-b095-64d4fa67395e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:09.600609 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-77f211ff-f9aa-4bf4-b095-64d4fa67395e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.169219 Dec 15 13:06:09.601199 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 167/389] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:09 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:09.605483 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-9a2a5a70-f535-4f05-8777-2950a49b1aae tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:09.606103 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-9a2a5a70-f535-4f05-8777-2950a49b1aae tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:09.612711 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9a2a5a70-f535-4f05-8777-2950a49b1aae tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:09.613167 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9a2a5a70-f535-4f05-8777-2950a49b1aae tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:09.613973 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9a2a5a70-f535-4f05-8777-2950a49b1aae tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:09.614438 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9a2a5a70-f535-4f05-8777-2950a49b1aae tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:09.636823 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-cf4d272f-29f9-4771-b01b-ef186fd433f8 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:09.646038 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-cf4d272f-29f9-4771-b01b-ef186fd433f8 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1356 microversion: 2.1 time: 0.181259 Dec 15 13:06:09.646664 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 223/390] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:09 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1356 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:09.750805 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-9a2a5a70-f535-4f05-8777-2950a49b1aae tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:09.758861 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-9a2a5a70-f535-4f05-8777-2950a49b1aae tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1521 microversion: 2.1 time: 0.156575 Dec 15 13:06:09.759510 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 168/391] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:09 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:09.791213 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0a6a1c5f-c021-41fb-8762-7b9a84b9f933 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:09.791804 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0a6a1c5f-c021-41fb-8762-7b9a84b9f933 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:09.798542 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0a6a1c5f-c021-41fb-8762-7b9a84b9f933 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:09.798980 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0a6a1c5f-c021-41fb-8762-7b9a84b9f933 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:09.799744 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0a6a1c5f-c021-41fb-8762-7b9a84b9f933 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:09.800165 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0a6a1c5f-c021-41fb-8762-7b9a84b9f933 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:09.941010 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0a6a1c5f-c021-41fb-8762-7b9a84b9f933 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:09.950957 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0a6a1c5f-c021-41fb-8762-7b9a84b9f933 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:09.952745 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0a6a1c5f-c021-41fb-8762-7b9a84b9f933 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:09.954187 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-0a6a1c5f-c021-41fb-8762-7b9a84b9f933 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1722 microversion: 2.20 time: 0.166503 Dec 15 13:06:09.955253 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 224/392] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:09 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:06:10.064413 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-f40d68f2-a65f-4196-bcb2-8516936fe525 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:10.065061 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-f40d68f2-a65f-4196-bcb2-8516936fe525 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: c12aa550-5e0a-4766-a6c6-d4acab7281b2] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:10.071477 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f40d68f2-a65f-4196-bcb2-8516936fe525 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:10.071922 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f40d68f2-a65f-4196-bcb2-8516936fe525 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:10.072694 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f40d68f2-a65f-4196-bcb2-8516936fe525 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:10.073127 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f40d68f2-a65f-4196-bcb2-8516936fe525 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:10.212463 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-f40d68f2-a65f-4196-bcb2-8516936fe525 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:10.222318 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-f40d68f2-a65f-4196-bcb2-8516936fe525 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2" status: 200 len: 1314 microversion: 2.1 time: 0.161516 Dec 15 13:06:10.223060 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 169/393] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:10 2021] GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:10.251154 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5815c846-8e1e-4cd0-8120-5cb2e0422fab tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:10.251812 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5815c846-8e1e-4cd0-8120-5cb2e0422fab tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:10.258122 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5815c846-8e1e-4cd0-8120-5cb2e0422fab tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:10.258600 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5815c846-8e1e-4cd0-8120-5cb2e0422fab tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:10.259489 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5815c846-8e1e-4cd0-8120-5cb2e0422fab tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:10.260184 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5815c846-8e1e-4cd0-8120-5cb2e0422fab tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:10.432413 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5815c846-8e1e-4cd0-8120-5cb2e0422fab tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:10.439887 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5815c846-8e1e-4cd0-8120-5cb2e0422fab tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1318 microversion: 2.1 time: 0.192490 Dec 15 13:06:10.440428 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 225/394] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:10 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:10.626077 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-638299ce-3f57-40b7-ae96-5a6a656c4573 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:10.628796 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-638299ce-3f57-40b7-ae96-5a6a656c4573 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:10.638554 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-638299ce-3f57-40b7-ae96-5a6a656c4573 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:10.639176 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-638299ce-3f57-40b7-ae96-5a6a656c4573 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:10.640260 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-638299ce-3f57-40b7-ae96-5a6a656c4573 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:10.641606 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-638299ce-3f57-40b7-ae96-5a6a656c4573 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:10.664573 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-62340e97-d17c-4e58-a542-84e19ead2bca tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:10.665177 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-62340e97-d17c-4e58-a542-84e19ead2bca tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:10.671079 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-62340e97-d17c-4e58-a542-84e19ead2bca tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:10.671554 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-62340e97-d17c-4e58-a542-84e19ead2bca tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:10.672430 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-62340e97-d17c-4e58-a542-84e19ead2bca tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:10.672872 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-62340e97-d17c-4e58-a542-84e19ead2bca tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:10.802452 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-638299ce-3f57-40b7-ae96-5a6a656c4573 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:10.813477 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-638299ce-3f57-40b7-ae96-5a6a656c4573 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.192435 Dec 15 13:06:10.818180 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 170/395] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:10 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:10.818868 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-62340e97-d17c-4e58-a542-84e19ead2bca tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:10.820079 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-d1635ab5-9616-4733-816e-e8980877e5c9 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:10.820918 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-d1635ab5-9616-4733-816e-e8980877e5c9 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:10.823819 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-62340e97-d17c-4e58-a542-84e19ead2bca tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1356 microversion: 2.1 time: 0.163941 Dec 15 13:06:10.824474 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 226/396] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:10 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1356 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:10.827302 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d1635ab5-9616-4733-816e-e8980877e5c9 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:10.827795 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d1635ab5-9616-4733-816e-e8980877e5c9 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:10.829209 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d1635ab5-9616-4733-816e-e8980877e5c9 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:10.829641 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d1635ab5-9616-4733-816e-e8980877e5c9 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:10.972247 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-d1635ab5-9616-4733-816e-e8980877e5c9 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:10.973146 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-47c4a737-a415-4009-9654-5669c93b7f0b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:10.973780 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-47c4a737-a415-4009-9654-5669c93b7f0b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:10.979783 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-47c4a737-a415-4009-9654-5669c93b7f0b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:10.979993 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-d1635ab5-9616-4733-816e-e8980877e5c9 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1521 microversion: 2.1 time: 0.164212 Dec 15 13:06:10.980223 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-47c4a737-a415-4009-9654-5669c93b7f0b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:10.981045 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 171/397] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:10 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:10.981366 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-47c4a737-a415-4009-9654-5669c93b7f0b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:10.981817 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-47c4a737-a415-4009-9654-5669c93b7f0b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:11.115242 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-47c4a737-a415-4009-9654-5669c93b7f0b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:11.123101 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-47c4a737-a415-4009-9654-5669c93b7f0b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:11.124594 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-47c4a737-a415-4009-9654-5669c93b7f0b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:11.125776 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-47c4a737-a415-4009-9654-5669c93b7f0b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1722 microversion: 2.20 time: 0.156897 Dec 15 13:06:11.126433 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 227/398] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:10 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:06:11.243563 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-5558799b-1ec6-4cfa-a48b-64e560c230b4 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:11.244119 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-5558799b-1ec6-4cfa-a48b-64e560c230b4 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: c12aa550-5e0a-4766-a6c6-d4acab7281b2] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:11.250351 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5558799b-1ec6-4cfa-a48b-64e560c230b4 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:11.250807 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5558799b-1ec6-4cfa-a48b-64e560c230b4 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:11.251587 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5558799b-1ec6-4cfa-a48b-64e560c230b4 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:11.252021 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5558799b-1ec6-4cfa-a48b-64e560c230b4 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:11.387294 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-5558799b-1ec6-4cfa-a48b-64e560c230b4 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:11.396318 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-5558799b-1ec6-4cfa-a48b-64e560c230b4 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2" status: 200 len: 1314 microversion: 2.1 time: 0.156332 Dec 15 13:06:11.396888 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 172/399] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:11 2021] GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:11.457155 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-122cb5cd-b8fc-4b24-ae2e-d833a07459ac tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:11.457611 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-122cb5cd-b8fc-4b24-ae2e-d833a07459ac tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:11.471186 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-122cb5cd-b8fc-4b24-ae2e-d833a07459ac tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:11.471638 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-122cb5cd-b8fc-4b24-ae2e-d833a07459ac tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:11.472427 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-122cb5cd-b8fc-4b24-ae2e-d833a07459ac tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:11.472866 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-122cb5cd-b8fc-4b24-ae2e-d833a07459ac tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:11.686586 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-122cb5cd-b8fc-4b24-ae2e-d833a07459ac tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:11.698644 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-122cb5cd-b8fc-4b24-ae2e-d833a07459ac tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1318 microversion: 2.1 time: 0.245301 Dec 15 13:06:11.699715 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 228/400] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:11 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:11.833457 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-a9c29c68-5e81-4949-a107-c572a4ebdd10 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:11.834353 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-a9c29c68-5e81-4949-a107-c572a4ebdd10 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:11.841692 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a9c29c68-5e81-4949-a107-c572a4ebdd10 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:11.842710 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a9c29c68-5e81-4949-a107-c572a4ebdd10 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:11.843686 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a9c29c68-5e81-4949-a107-c572a4ebdd10 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:11.844886 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a9c29c68-5e81-4949-a107-c572a4ebdd10 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:11.845001 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e81817b8-eef2-49ef-97f4-3b4243b2c5ef tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:11.845556 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e81817b8-eef2-49ef-97f4-3b4243b2c5ef tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:11.852360 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e81817b8-eef2-49ef-97f4-3b4243b2c5ef tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:11.852805 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e81817b8-eef2-49ef-97f4-3b4243b2c5ef tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:11.853597 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e81817b8-eef2-49ef-97f4-3b4243b2c5ef tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:11.854035 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e81817b8-eef2-49ef-97f4-3b4243b2c5ef tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:12.106046 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-a9c29c68-5e81-4949-a107-c572a4ebdd10 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:12.121714 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-a9c29c68-5e81-4949-a107-c572a4ebdd10 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.293994 Dec 15 13:06:12.132090 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 173/401] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:11 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:12.138702 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-45d96aa2-15c6-4938-abd5-8b233f9a6992 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:12.143516 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-45d96aa2-15c6-4938-abd5-8b233f9a6992 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:12.153726 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-45d96aa2-15c6-4938-abd5-8b233f9a6992 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:12.154212 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-45d96aa2-15c6-4938-abd5-8b233f9a6992 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:12.155033 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-45d96aa2-15c6-4938-abd5-8b233f9a6992 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:12.159422 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-45d96aa2-15c6-4938-abd5-8b233f9a6992 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:12.298092 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e81817b8-eef2-49ef-97f4-3b4243b2c5ef tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:12.311157 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e81817b8-eef2-49ef-97f4-3b4243b2c5ef tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1356 microversion: 2.1 time: 0.471140 Dec 15 13:06:12.322473 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 229/402] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:11 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1356 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:12.328427 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8c131f6e-e6fd-47a1-aca8-49ff18c6eb9e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:12.329332 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8c131f6e-e6fd-47a1-aca8-49ff18c6eb9e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:12.337909 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8c131f6e-e6fd-47a1-aca8-49ff18c6eb9e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:12.338549 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8c131f6e-e6fd-47a1-aca8-49ff18c6eb9e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:12.340146 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8c131f6e-e6fd-47a1-aca8-49ff18c6eb9e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:12.340489 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8c131f6e-e6fd-47a1-aca8-49ff18c6eb9e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:12.447593 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-45d96aa2-15c6-4938-abd5-8b233f9a6992 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:12.458568 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-45d96aa2-15c6-4938-abd5-8b233f9a6992 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1521 microversion: 2.1 time: 0.325320 Dec 15 13:06:12.459196 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 174/403] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:12 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:12.464744 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-e5b93586-e299-4be0-a83f-60668e91c7cc tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:12.465757 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-e5b93586-e299-4be0-a83f-60668e91c7cc tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: c12aa550-5e0a-4766-a6c6-d4acab7281b2] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:12.475381 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e5b93586-e299-4be0-a83f-60668e91c7cc tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:12.475872 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e5b93586-e299-4be0-a83f-60668e91c7cc tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:12.476796 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e5b93586-e299-4be0-a83f-60668e91c7cc tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:12.477309 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e5b93586-e299-4be0-a83f-60668e91c7cc tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:12.602211 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8c131f6e-e6fd-47a1-aca8-49ff18c6eb9e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:12.616775 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8c131f6e-e6fd-47a1-aca8-49ff18c6eb9e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:12.618408 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8c131f6e-e6fd-47a1-aca8-49ff18c6eb9e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:12.619632 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8c131f6e-e6fd-47a1-aca8-49ff18c6eb9e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1743 microversion: 2.20 time: 0.295591 Dec 15 13:06:12.620434 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 230/404] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:12 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1743 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:06:12.629433 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-68ebc7cc-802c-4e87-9ce0-c18eb085a9e9 req-c06e0b27-a29f-4b12-9b77-3de32ce72710 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b62c709-a647-468b-bb79-1e1e20832c1e", "tag": "235d69ca-304f-4a79-a570-8c3fd9220dcf"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:06:12.631061 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:06:12.631061 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:06:12.652828 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-68ebc7cc-802c-4e87-9ce0-c18eb085a9e9 req-c06e0b27-a29f-4b12-9b77-3de32ce72710 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:12.653502 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-68ebc7cc-802c-4e87-9ce0-c18eb085a9e9 req-c06e0b27-a29f-4b12-9b77-3de32ce72710 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:12.669107 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-68ebc7cc-802c-4e87-9ce0-c18eb085a9e9 req-c06e0b27-a29f-4b12-9b77-3de32ce72710 service nova] Creating event network-changed:235d69ca-304f-4a79-a570-8c3fd9220dcf for instance 5b62c709-a647-468b-bb79-1e1e20832c1e on hv-cinder-81322 Dec 15 13:06:12.676553 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-68ebc7cc-802c-4e87-9ce0-c18eb085a9e9 req-c06e0b27-a29f-4b12-9b77-3de32ce72710 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050436 Dec 15 13:06:12.677394 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 231/405] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:06:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:06:12.719606 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7d39f6d0-4dd3-49b2-a3dc-e51e62b3a839 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:12.721999 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7d39f6d0-4dd3-49b2-a3dc-e51e62b3a839 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:12.729087 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7d39f6d0-4dd3-49b2-a3dc-e51e62b3a839 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:12.729615 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7d39f6d0-4dd3-49b2-a3dc-e51e62b3a839 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:12.730525 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7d39f6d0-4dd3-49b2-a3dc-e51e62b3a839 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:12.731056 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7d39f6d0-4dd3-49b2-a3dc-e51e62b3a839 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:12.743774 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-e5b93586-e299-4be0-a83f-60668e91c7cc tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:12.752985 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-e5b93586-e299-4be0-a83f-60668e91c7cc tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2" status: 200 len: 1314 microversion: 2.1 time: 0.292346 Dec 15 13:06:12.754582 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 175/406] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:12 2021] GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:12.889699 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-7d39f6d0-4dd3-49b2-a3dc-e51e62b3a839 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:12.907016 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7d39f6d0-4dd3-49b2-a3dc-e51e62b3a839 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1318 microversion: 2.1 time: 0.192192 Dec 15 13:06:12.913757 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 232/407] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:12 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:13.144371 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-50ad419b-7843-4b48-a0b0-7cac0c1c2545 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:13.145170 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-50ad419b-7843-4b48-a0b0-7cac0c1c2545 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:13.153695 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-50ad419b-7843-4b48-a0b0-7cac0c1c2545 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:13.154336 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-50ad419b-7843-4b48-a0b0-7cac0c1c2545 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:13.155243 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-50ad419b-7843-4b48-a0b0-7cac0c1c2545 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:13.155793 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-50ad419b-7843-4b48-a0b0-7cac0c1c2545 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:13.329223 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-3639d49f-1504-49af-9609-ff84df4fabf0 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:13.329889 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-3639d49f-1504-49af-9609-ff84df4fabf0 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:13.337018 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3639d49f-1504-49af-9609-ff84df4fabf0 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:13.338465 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3639d49f-1504-49af-9609-ff84df4fabf0 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:13.340010 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3639d49f-1504-49af-9609-ff84df4fabf0 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:13.340951 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3639d49f-1504-49af-9609-ff84df4fabf0 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:13.417838 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-50ad419b-7843-4b48-a0b0-7cac0c1c2545 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:13.426331 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-50ad419b-7843-4b48-a0b0-7cac0c1c2545 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.287551 Dec 15 13:06:13.427470 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 176/408] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:13 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:13.476076 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-4a5e00c2-2fbb-423a-86b8-2025348dfc63 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:13.477231 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-4a5e00c2-2fbb-423a-86b8-2025348dfc63 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:13.484772 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4a5e00c2-2fbb-423a-86b8-2025348dfc63 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:13.485273 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4a5e00c2-2fbb-423a-86b8-2025348dfc63 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:13.486339 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4a5e00c2-2fbb-423a-86b8-2025348dfc63 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:13.486973 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4a5e00c2-2fbb-423a-86b8-2025348dfc63 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:13.506343 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-3639d49f-1504-49af-9609-ff84df4fabf0 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:13.513963 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-3639d49f-1504-49af-9609-ff84df4fabf0 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1356 microversion: 2.1 time: 0.188678 Dec 15 13:06:13.524910 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 233/409] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:13 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1356 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:13.639613 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5a16de11-95a4-4e56-87ee-32eedf179d52 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:13.640208 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5a16de11-95a4-4e56-87ee-32eedf179d52 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:13.647090 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5a16de11-95a4-4e56-87ee-32eedf179d52 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:13.647546 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5a16de11-95a4-4e56-87ee-32eedf179d52 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:13.648334 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5a16de11-95a4-4e56-87ee-32eedf179d52 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:13.648800 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5a16de11-95a4-4e56-87ee-32eedf179d52 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:13.731527 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-4a5e00c2-2fbb-423a-86b8-2025348dfc63 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:13.743254 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-4a5e00c2-2fbb-423a-86b8-2025348dfc63 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1521 microversion: 2.1 time: 0.271181 Dec 15 13:06:13.744411 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 177/410] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:13 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:13.771636 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-833458a8-7323-4578-9826-027577bb9e64 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:13.772252 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-833458a8-7323-4578-9826-027577bb9e64 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: c12aa550-5e0a-4766-a6c6-d4acab7281b2] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:13.779241 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-833458a8-7323-4578-9826-027577bb9e64 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:13.779865 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-833458a8-7323-4578-9826-027577bb9e64 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:13.780731 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-833458a8-7323-4578-9826-027577bb9e64 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:13.781358 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-833458a8-7323-4578-9826-027577bb9e64 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:13.815763 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5a16de11-95a4-4e56-87ee-32eedf179d52 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:13.825109 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5a16de11-95a4-4e56-87ee-32eedf179d52 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:13.827038 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5a16de11-95a4-4e56-87ee-32eedf179d52 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:13.828489 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5a16de11-95a4-4e56-87ee-32eedf179d52 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1743 microversion: 2.20 time: 0.192346 Dec 15 13:06:13.829132 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 234/411] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:13 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1743 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:06:13.924717 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-833458a8-7323-4578-9826-027577bb9e64 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:13.928719 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d0454fc1-787e-4472-b0e0-23b130fba062 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:13.929440 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d0454fc1-787e-4472-b0e0-23b130fba062 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:13.931988 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-833458a8-7323-4578-9826-027577bb9e64 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2" status: 200 len: 1314 microversion: 2.1 time: 0.164444 Dec 15 13:06:13.932560 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 178/412] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:13 2021] GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:13.935600 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d0454fc1-787e-4472-b0e0-23b130fba062 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:13.936066 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d0454fc1-787e-4472-b0e0-23b130fba062 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:13.936937 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d0454fc1-787e-4472-b0e0-23b130fba062 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:13.937976 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d0454fc1-787e-4472-b0e0-23b130fba062 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:14.069363 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d0454fc1-787e-4472-b0e0-23b130fba062 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:14.076767 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d0454fc1-787e-4472-b0e0-23b130fba062 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1507 microversion: 2.1 time: 0.151747 Dec 15 13:06:14.077325 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 235/413] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:13 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:14.444099 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-93e3364d-ad6a-4df6-9620-a0e57291765c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:14.444626 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-93e3364d-ad6a-4df6-9620-a0e57291765c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:14.451031 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-93e3364d-ad6a-4df6-9620-a0e57291765c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:14.451482 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-93e3364d-ad6a-4df6-9620-a0e57291765c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:14.452261 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-93e3364d-ad6a-4df6-9620-a0e57291765c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:14.452699 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-93e3364d-ad6a-4df6-9620-a0e57291765c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:14.533509 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e8faa802-fa71-4f11-b2ee-b630300ee01e tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:14.534414 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e8faa802-fa71-4f11-b2ee-b630300ee01e tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:14.541703 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e8faa802-fa71-4f11-b2ee-b630300ee01e tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:14.542252 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e8faa802-fa71-4f11-b2ee-b630300ee01e tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:14.543171 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e8faa802-fa71-4f11-b2ee-b630300ee01e tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:14.543713 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e8faa802-fa71-4f11-b2ee-b630300ee01e tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:14.584602 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-93e3364d-ad6a-4df6-9620-a0e57291765c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:14.593387 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-93e3364d-ad6a-4df6-9620-a0e57291765c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.153175 Dec 15 13:06:14.594549 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 179/414] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:14 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:14.678297 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e8faa802-fa71-4f11-b2ee-b630300ee01e tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:14.685389 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e8faa802-fa71-4f11-b2ee-b630300ee01e tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1356 microversion: 2.1 time: 0.156669 Dec 15 13:06:14.685947 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 236/415] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:14 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1356 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:14.760811 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-e5b183c5-c6a6-4f61-ba4a-1ee4a650af7e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:14.761334 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-e5b183c5-c6a6-4f61-ba4a-1ee4a650af7e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:14.767664 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e5b183c5-c6a6-4f61-ba4a-1ee4a650af7e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:14.768116 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e5b183c5-c6a6-4f61-ba4a-1ee4a650af7e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:14.769154 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e5b183c5-c6a6-4f61-ba4a-1ee4a650af7e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:14.769591 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e5b183c5-c6a6-4f61-ba4a-1ee4a650af7e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:14.847380 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4e80ab17-18ad-43d9-bf19-fd2955af6ad8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:14.847994 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4e80ab17-18ad-43d9-bf19-fd2955af6ad8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:14.853866 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4e80ab17-18ad-43d9-bf19-fd2955af6ad8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:14.854316 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4e80ab17-18ad-43d9-bf19-fd2955af6ad8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:14.855182 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4e80ab17-18ad-43d9-bf19-fd2955af6ad8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:14.855561 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4e80ab17-18ad-43d9-bf19-fd2955af6ad8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:14.898755 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-e5b183c5-c6a6-4f61-ba4a-1ee4a650af7e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:14.907479 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-e5b183c5-c6a6-4f61-ba4a-1ee4a650af7e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1521 microversion: 2.1 time: 0.150381 Dec 15 13:06:14.908056 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 180/416] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:14 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:14.948287 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-ae0fd4af-5c62-4e8d-9815-0af122e19193 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:14.948891 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-ae0fd4af-5c62-4e8d-9815-0af122e19193 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: c12aa550-5e0a-4766-a6c6-d4acab7281b2] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:14.955340 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ae0fd4af-5c62-4e8d-9815-0af122e19193 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:14.955785 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ae0fd4af-5c62-4e8d-9815-0af122e19193 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:14.956553 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ae0fd4af-5c62-4e8d-9815-0af122e19193 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:14.956984 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ae0fd4af-5c62-4e8d-9815-0af122e19193 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:14.990616 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4e80ab17-18ad-43d9-bf19-fd2955af6ad8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:14.998554 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4e80ab17-18ad-43d9-bf19-fd2955af6ad8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:15.000360 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4e80ab17-18ad-43d9-bf19-fd2955af6ad8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:15.001529 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4e80ab17-18ad-43d9-bf19-fd2955af6ad8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1743 microversion: 2.20 time: 0.158511 Dec 15 13:06:15.002089 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 237/417] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:14 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:06:15.086549 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-ae0fd4af-5c62-4e8d-9815-0af122e19193 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:15.094320 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-ae0fd4af-5c62-4e8d-9815-0af122e19193 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2" status: 200 len: 1314 microversion: 2.1 time: 0.148894 Dec 15 13:06:15.094889 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 181/418] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:14 2021] GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:15.611778 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-2319d422-91a2-475e-af07-b915076c7b7d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:15.612311 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-2319d422-91a2-475e-af07-b915076c7b7d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:15.618576 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2319d422-91a2-475e-af07-b915076c7b7d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:15.619019 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2319d422-91a2-475e-af07-b915076c7b7d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:15.619785 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2319d422-91a2-475e-af07-b915076c7b7d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:15.620213 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2319d422-91a2-475e-af07-b915076c7b7d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:15.701981 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-995ce09d-0f1c-4f3a-a14d-f6d07b802d39 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:15.702650 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-995ce09d-0f1c-4f3a-a14d-f6d07b802d39 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:15.709207 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-995ce09d-0f1c-4f3a-a14d-f6d07b802d39 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:15.709656 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-995ce09d-0f1c-4f3a-a14d-f6d07b802d39 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:15.710499 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-995ce09d-0f1c-4f3a-a14d-f6d07b802d39 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:15.710914 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-995ce09d-0f1c-4f3a-a14d-f6d07b802d39 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:15.755995 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-2319d422-91a2-475e-af07-b915076c7b7d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:15.763701 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-2319d422-91a2-475e-af07-b915076c7b7d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.155791 Dec 15 13:06:15.764257 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 238/419] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:15 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:15.845545 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-995ce09d-0f1c-4f3a-a14d-f6d07b802d39 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:15.853240 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-995ce09d-0f1c-4f3a-a14d-f6d07b802d39 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1356 microversion: 2.1 time: 0.155052 Dec 15 13:06:15.853896 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 182/420] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:15 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1356 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:15.924657 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-be48a50f-91d0-4823-9e65-6d57a94999a8 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:15.925328 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-be48a50f-91d0-4823-9e65-6d57a94999a8 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:15.931212 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be48a50f-91d0-4823-9e65-6d57a94999a8 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:15.931655 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be48a50f-91d0-4823-9e65-6d57a94999a8 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:15.932416 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be48a50f-91d0-4823-9e65-6d57a94999a8 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:15.932846 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be48a50f-91d0-4823-9e65-6d57a94999a8 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:16.020114 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-b645a807-d6a5-4b2d-80a7-5165c1417b4d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:16.020716 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-b645a807-d6a5-4b2d-80a7-5165c1417b4d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:16.026624 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b645a807-d6a5-4b2d-80a7-5165c1417b4d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:16.027068 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b645a807-d6a5-4b2d-80a7-5165c1417b4d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:16.027843 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b645a807-d6a5-4b2d-80a7-5165c1417b4d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:16.028272 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b645a807-d6a5-4b2d-80a7-5165c1417b4d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:16.061355 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-be48a50f-91d0-4823-9e65-6d57a94999a8 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:16.069392 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-be48a50f-91d0-4823-9e65-6d57a94999a8 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1521 microversion: 2.1 time: 0.148489 Dec 15 13:06:16.069969 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 239/421] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:15 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:16.110819 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-922fafae-b336-401f-adb2-9c4cd6b3e67d tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:16.111422 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-922fafae-b336-401f-adb2-9c4cd6b3e67d tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: c12aa550-5e0a-4766-a6c6-d4acab7281b2] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:16.117450 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-922fafae-b336-401f-adb2-9c4cd6b3e67d tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:16.117894 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-922fafae-b336-401f-adb2-9c4cd6b3e67d tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:16.118713 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-922fafae-b336-401f-adb2-9c4cd6b3e67d tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:16.119141 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-922fafae-b336-401f-adb2-9c4cd6b3e67d tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:16.160250 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-b645a807-d6a5-4b2d-80a7-5165c1417b4d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:16.168134 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-b645a807-d6a5-4b2d-80a7-5165c1417b4d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:16.169723 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-b645a807-d6a5-4b2d-80a7-5165c1417b4d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:16.171012 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-b645a807-d6a5-4b2d-80a7-5165c1417b4d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1743 microversion: 2.20 time: 0.155374 Dec 15 13:06:16.171651 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 183/422] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:16 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:06:16.252618 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-922fafae-b336-401f-adb2-9c4cd6b3e67d tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:16.260045 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-922fafae-b336-401f-adb2-9c4cd6b3e67d tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2" status: 200 len: 1314 microversion: 2.1 time: 0.152717 Dec 15 13:06:16.260826 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 240/423] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:16 2021] GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:16.781919 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-cc12c2a1-c6c6-4214-a762-19e7f3b58b22 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:16.782964 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-cc12c2a1-c6c6-4214-a762-19e7f3b58b22 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:16.788976 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cc12c2a1-c6c6-4214-a762-19e7f3b58b22 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:16.789419 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cc12c2a1-c6c6-4214-a762-19e7f3b58b22 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:16.790207 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cc12c2a1-c6c6-4214-a762-19e7f3b58b22 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:16.791086 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cc12c2a1-c6c6-4214-a762-19e7f3b58b22 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:16.871094 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ce70ecd9-5a34-4680-ac42-f78e10fcb29e tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:16.871296 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ce70ecd9-5a34-4680-ac42-f78e10fcb29e tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:16.882329 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce70ecd9-5a34-4680-ac42-f78e10fcb29e tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:16.882868 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce70ecd9-5a34-4680-ac42-f78e10fcb29e tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:16.883703 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce70ecd9-5a34-4680-ac42-f78e10fcb29e tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:16.884139 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce70ecd9-5a34-4680-ac42-f78e10fcb29e tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:16.942445 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-cc12c2a1-c6c6-4214-a762-19e7f3b58b22 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:16.963836 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-cc12c2a1-c6c6-4214-a762-19e7f3b58b22 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.185669 Dec 15 13:06:16.964732 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 184/424] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:16 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:17.048938 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ce70ecd9-5a34-4680-ac42-f78e10fcb29e tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:17.056485 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ce70ecd9-5a34-4680-ac42-f78e10fcb29e tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1356 microversion: 2.1 time: 0.190012 Dec 15 13:06:17.057145 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 241/425] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:16 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1356 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:17.089667 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-31bc3c70-52fd-4287-bbe2-5a9416995087 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:17.090814 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-31bc3c70-52fd-4287-bbe2-5a9416995087 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:17.101026 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-31bc3c70-52fd-4287-bbe2-5a9416995087 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:17.101848 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-31bc3c70-52fd-4287-bbe2-5a9416995087 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:17.103297 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-31bc3c70-52fd-4287-bbe2-5a9416995087 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:17.104107 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-31bc3c70-52fd-4287-bbe2-5a9416995087 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:17.190359 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5adcf28e-60a1-4c01-8b83-204642138b35 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:17.191062 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5adcf28e-60a1-4c01-8b83-204642138b35 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:17.198313 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5adcf28e-60a1-4c01-8b83-204642138b35 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:17.199595 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5adcf28e-60a1-4c01-8b83-204642138b35 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:17.200564 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5adcf28e-60a1-4c01-8b83-204642138b35 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:17.201324 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5adcf28e-60a1-4c01-8b83-204642138b35 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:17.249246 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-31bc3c70-52fd-4287-bbe2-5a9416995087 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:17.259656 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-31bc3c70-52fd-4287-bbe2-5a9416995087 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1521 microversion: 2.1 time: 0.175742 Dec 15 13:06:17.260694 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 185/426] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:17 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:17.278545 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-4a6a14d9-f130-4983-95a6-cd52592cb2eb tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:17.279234 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-4a6a14d9-f130-4983-95a6-cd52592cb2eb tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: c12aa550-5e0a-4766-a6c6-d4acab7281b2] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:17.285970 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4a6a14d9-f130-4983-95a6-cd52592cb2eb tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:17.286448 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4a6a14d9-f130-4983-95a6-cd52592cb2eb tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:17.287237 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4a6a14d9-f130-4983-95a6-cd52592cb2eb tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:17.287667 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4a6a14d9-f130-4983-95a6-cd52592cb2eb tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:17.361327 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5adcf28e-60a1-4c01-8b83-204642138b35 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:17.370671 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5adcf28e-60a1-4c01-8b83-204642138b35 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:17.372642 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5adcf28e-60a1-4c01-8b83-204642138b35 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:17.373879 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5adcf28e-60a1-4c01-8b83-204642138b35 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1743 microversion: 2.20 time: 0.188391 Dec 15 13:06:17.374687 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 242/427] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:17 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1743 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:06:17.429601 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-4a6a14d9-f130-4983-95a6-cd52592cb2eb tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:17.437025 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-4a6a14d9-f130-4983-95a6-cd52592cb2eb tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2" status: 200 len: 1498 microversion: 2.1 time: 0.163284 Dec 15 13:06:17.437828 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 186/428] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:17 2021] GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2 => generated 1498 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:17.980881 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1b313a62-8042-4830-b601-1fde083797b4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:17.981455 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1b313a62-8042-4830-b601-1fde083797b4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:17.987865 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1b313a62-8042-4830-b601-1fde083797b4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:17.988312 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1b313a62-8042-4830-b601-1fde083797b4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:17.989143 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1b313a62-8042-4830-b601-1fde083797b4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:17.989619 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1b313a62-8042-4830-b601-1fde083797b4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:18.074399 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-ddf0946a-42bf-4f26-a3b0-c38ac789c904 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:18.076029 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-ddf0946a-42bf-4f26-a3b0-c38ac789c904 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:18.084115 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ddf0946a-42bf-4f26-a3b0-c38ac789c904 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:18.084784 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ddf0946a-42bf-4f26-a3b0-c38ac789c904 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:18.086174 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ddf0946a-42bf-4f26-a3b0-c38ac789c904 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:18.087151 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ddf0946a-42bf-4f26-a3b0-c38ac789c904 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:18.154332 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1b313a62-8042-4830-b601-1fde083797b4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:18.165354 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1b313a62-8042-4830-b601-1fde083797b4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.188274 Dec 15 13:06:18.175335 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 243/429] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:17 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:18.276678 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d9e4c532-3e19-4b2f-8411-0574f6f1c0fc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:18.277531 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d9e4c532-3e19-4b2f-8411-0574f6f1c0fc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:18.284121 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d9e4c532-3e19-4b2f-8411-0574f6f1c0fc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:18.292560 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d9e4c532-3e19-4b2f-8411-0574f6f1c0fc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:18.295030 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-ddf0946a-42bf-4f26-a3b0-c38ac789c904 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:18.295183 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d9e4c532-3e19-4b2f-8411-0574f6f1c0fc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:18.295511 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d9e4c532-3e19-4b2f-8411-0574f6f1c0fc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:18.306673 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-ddf0946a-42bf-4f26-a3b0-c38ac789c904 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1356 microversion: 2.1 time: 0.236146 Dec 15 13:06:18.308031 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 187/430] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:18 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1356 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:18.392405 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-d1ab0922-17a7-42d2-b726-d154b4be25a1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:18.393109 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-d1ab0922-17a7-42d2-b726-d154b4be25a1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:18.405594 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d1ab0922-17a7-42d2-b726-d154b4be25a1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:18.408397 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d1ab0922-17a7-42d2-b726-d154b4be25a1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:18.409307 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d1ab0922-17a7-42d2-b726-d154b4be25a1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:18.411414 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d1ab0922-17a7-42d2-b726-d154b4be25a1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:18.476343 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d9e4c532-3e19-4b2f-8411-0574f6f1c0fc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:18.486412 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d9e4c532-3e19-4b2f-8411-0574f6f1c0fc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1521 microversion: 2.1 time: 0.212370 Dec 15 13:06:18.488132 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 244/431] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:18 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:18.571279 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-3524e922-850e-41e7-86fe-5d5f7f0a4ba2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "377d38d0-67fd-42f8-88ef-054b3cd71eed"}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:06:18.572757 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-3524e922-850e-41e7-86fe-5d5f7f0a4ba2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:18.579793 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3524e922-850e-41e7-86fe-5d5f7f0a4ba2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:18.580603 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3524e922-850e-41e7-86fe-5d5f7f0a4ba2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:18.581694 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3524e922-850e-41e7-86fe-5d5f7f0a4ba2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:18.582263 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3524e922-850e-41e7-86fe-5d5f7f0a4ba2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:18.899258 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-d1ab0922-17a7-42d2-b726-d154b4be25a1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:18.916602 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-d1ab0922-17a7-42d2-b726-d154b4be25a1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:18.920296 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-d1ab0922-17a7-42d2-b726-d154b4be25a1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:18.923420 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-d1ab0922-17a7-42d2-b726-d154b4be25a1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1738 microversion: 2.20 time: 0.534134 Dec 15 13:06:18.939891 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 188/432] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:18 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1738 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:06:19.190009 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-988308bf-fcdd-43b9-9785-09c3a90be8ea tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:19.192264 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-988308bf-fcdd-43b9-9785-09c3a90be8ea tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:19.199914 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-988308bf-fcdd-43b9-9785-09c3a90be8ea tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:19.200360 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-988308bf-fcdd-43b9-9785-09c3a90be8ea tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:19.201152 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-988308bf-fcdd-43b9-9785-09c3a90be8ea tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:19.201585 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-988308bf-fcdd-43b9-9785-09c3a90be8ea tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:19.413159 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-988308bf-fcdd-43b9-9785-09c3a90be8ea tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:19.430119 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-988308bf-fcdd-43b9-9785-09c3a90be8ea tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.250276 Dec 15 13:06:19.431190 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 189/433] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:19 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:19.435644 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-6982a048-5e4f-4a1a-b2f6-8fc5880de9d4 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:19.436424 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-6982a048-5e4f-4a1a-b2f6-8fc5880de9d4 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:19.451811 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6982a048-5e4f-4a1a-b2f6-8fc5880de9d4 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:19.452561 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6982a048-5e4f-4a1a-b2f6-8fc5880de9d4 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:19.453419 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6982a048-5e4f-4a1a-b2f6-8fc5880de9d4 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:19.454475 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6982a048-5e4f-4a1a-b2f6-8fc5880de9d4 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:19.668705 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-6982a048-5e4f-4a1a-b2f6-8fc5880de9d4 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:19.677786 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-6982a048-5e4f-4a1a-b2f6-8fc5880de9d4 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1356 microversion: 2.1 time: 0.245382 Dec 15 13:06:19.678984 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 190/434] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:19 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1356 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:19.690089 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-defd453c-f291-4113-829b-1c875000589b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:19.690720 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-defd453c-f291-4113-829b-1c875000589b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:19.697670 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-defd453c-f291-4113-829b-1c875000589b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:19.698107 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-defd453c-f291-4113-829b-1c875000589b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:19.698916 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-defd453c-f291-4113-829b-1c875000589b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:19.699625 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-defd453c-f291-4113-829b-1c875000589b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:19.882363 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-defd453c-f291-4113-829b-1c875000589b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:19.890019 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-defd453c-f291-4113-829b-1c875000589b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1521 microversion: 2.1 time: 0.209888 Dec 15 13:06:19.892007 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 191/435] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:19 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:19.947409 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-4d561e7c-c497-415e-9508-3af64adab7dc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:19.948113 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-4d561e7c-c497-415e-9508-3af64adab7dc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:19.955058 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4d561e7c-c497-415e-9508-3af64adab7dc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:19.955606 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4d561e7c-c497-415e-9508-3af64adab7dc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:19.956557 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4d561e7c-c497-415e-9508-3af64adab7dc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:19.957017 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4d561e7c-c497-415e-9508-3af64adab7dc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:20.138157 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-4d561e7c-c497-415e-9508-3af64adab7dc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:20.167357 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-4d561e7c-c497-415e-9508-3af64adab7dc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:20.186698 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-4d561e7c-c497-415e-9508-3af64adab7dc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:20.188293 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-4d561e7c-c497-415e-9508-3af64adab7dc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1738 microversion: 2.20 time: 0.244940 Dec 15 13:06:20.190339 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 192/436] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:19 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1738 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:06:20.449026 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-6096549e-9cd4-4c76-b42c-3e8ab31c0b6f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:20.449637 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-6096549e-9cd4-4c76-b42c-3e8ab31c0b6f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:20.456243 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6096549e-9cd4-4c76-b42c-3e8ab31c0b6f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:20.465479 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6096549e-9cd4-4c76-b42c-3e8ab31c0b6f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:20.466590 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6096549e-9cd4-4c76-b42c-3e8ab31c0b6f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:20.467208 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6096549e-9cd4-4c76-b42c-3e8ab31c0b6f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:20.645123 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-6096549e-9cd4-4c76-b42c-3e8ab31c0b6f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:20.658739 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-6096549e-9cd4-4c76-b42c-3e8ab31c0b6f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.213249 Dec 15 13:06:20.659636 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 193/437] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:20 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:20.698122 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-81763e08-53b4-44f5-9b91-0639083f68db tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:20.698944 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-81763e08-53b4-44f5-9b91-0639083f68db tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:20.708937 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-81763e08-53b4-44f5-9b91-0639083f68db tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:20.709392 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-81763e08-53b4-44f5-9b91-0639083f68db tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:20.710210 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-81763e08-53b4-44f5-9b91-0639083f68db tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:20.710875 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-81763e08-53b4-44f5-9b91-0639083f68db tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:20.974440 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-81763e08-53b4-44f5-9b91-0639083f68db tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:20.982999 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-81763e08-53b4-44f5-9b91-0639083f68db tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1356 microversion: 2.1 time: 0.291438 Dec 15 13:06:20.983861 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 194/438] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:20 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1356 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:20.989494 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-1e08a2ad-12a3-424e-92f5-bed3c439f652 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:20.990240 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-1e08a2ad-12a3-424e-92f5-bed3c439f652 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:21.000981 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1e08a2ad-12a3-424e-92f5-bed3c439f652 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:21.001534 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1e08a2ad-12a3-424e-92f5-bed3c439f652 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:21.002655 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1e08a2ad-12a3-424e-92f5-bed3c439f652 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:21.003174 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1e08a2ad-12a3-424e-92f5-bed3c439f652 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:21.160715 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-1e08a2ad-12a3-424e-92f5-bed3c439f652 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:21.170802 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-1e08a2ad-12a3-424e-92f5-bed3c439f652 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1521 microversion: 2.1 time: 0.185730 Dec 15 13:06:21.171852 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 195/439] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:20 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:21.208328 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-0c4f44c5-a0d7-46f1-a41c-79ff6aa715f5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:21.209010 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-0c4f44c5-a0d7-46f1-a41c-79ff6aa715f5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:21.216064 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0c4f44c5-a0d7-46f1-a41c-79ff6aa715f5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:21.216953 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0c4f44c5-a0d7-46f1-a41c-79ff6aa715f5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:21.217935 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0c4f44c5-a0d7-46f1-a41c-79ff6aa715f5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:21.218519 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0c4f44c5-a0d7-46f1-a41c-79ff6aa715f5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:21.469141 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-3524e922-850e-41e7-86fe-5d5f7f0a4ba2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "POST /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.901436 Dec 15 13:06:21.471534 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 245/440] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Dec 15 13:06:18 2021] POST /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d/os-volume_attachments => generated 194 bytes in 2905 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:06:21.492293 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-1af35d03-daa6-4d78-ae9f-199e4b77f2cd req-56096e0a-578d-433d-8ade-c6c6cad6f1b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "703b5e88-39f0-436c-ac5a-f1701ec4d7c9", "name": "network-vif-plugged", "status": "completed", "tag": "82fec70a-827b-4ef1-8922-a834a47147e1"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:06:21.495488 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:06:21.495488 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:06:21.497351 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-0c4f44c5-a0d7-46f1-a41c-79ff6aa715f5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:21.509574 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-0c4f44c5-a0d7-46f1-a41c-79ff6aa715f5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:21.512260 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-0c4f44c5-a0d7-46f1-a41c-79ff6aa715f5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:21.513576 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-0c4f44c5-a0d7-46f1-a41c-79ff6aa715f5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1738 microversion: 2.20 time: 0.310078 Dec 15 13:06:21.515255 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 196/441] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:21 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1738 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:06:21.526953 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-1af35d03-daa6-4d78-ae9f-199e4b77f2cd req-56096e0a-578d-433d-8ade-c6c6cad6f1b1 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:21.527589 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-1af35d03-daa6-4d78-ae9f-199e4b77f2cd req-56096e0a-578d-433d-8ade-c6c6cad6f1b1 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:21.555310 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-1af35d03-daa6-4d78-ae9f-199e4b77f2cd req-56096e0a-578d-433d-8ade-c6c6cad6f1b1 service nova] Creating event network-vif-plugged:82fec70a-827b-4ef1-8922-a834a47147e1 for instance 703b5e88-39f0-436c-ac5a-f1701ec4d7c9 on hv-cinder-81322 Dec 15 13:06:21.560732 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-1af35d03-daa6-4d78-ae9f-199e4b77f2cd req-56096e0a-578d-433d-8ade-c6c6cad6f1b1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087658 Dec 15 13:06:21.562675 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 246/442] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:06:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:06:21.680651 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-feffa2e6-d28b-4bb5-8602-cef74a8c0542 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:21.681417 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-feffa2e6-d28b-4bb5-8602-cef74a8c0542 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:21.692717 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-feffa2e6-d28b-4bb5-8602-cef74a8c0542 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:21.694596 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-feffa2e6-d28b-4bb5-8602-cef74a8c0542 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:21.695989 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-feffa2e6-d28b-4bb5-8602-cef74a8c0542 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:21.696730 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-feffa2e6-d28b-4bb5-8602-cef74a8c0542 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:21.807321 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1e5ff843-48e0-468c-a521-e32a340cf446 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:21.808171 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1e5ff843-48e0-468c-a521-e32a340cf446 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: c12aa550-5e0a-4766-a6c6-d4acab7281b2] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:21.821276 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1e5ff843-48e0-468c-a521-e32a340cf446 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:21.821980 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1e5ff843-48e0-468c-a521-e32a340cf446 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:21.823450 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1e5ff843-48e0-468c-a521-e32a340cf446 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:21.824110 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1e5ff843-48e0-468c-a521-e32a340cf446 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:21.860290 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1e5ff843-48e0-468c-a521-e32a340cf446 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: c12aa550-5e0a-4766-a6c6-d4acab7281b2] Going to try to terminate instance {{(pid=116098) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:06:21.894994 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-feffa2e6-d28b-4bb5-8602-cef74a8c0542 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:21.907981 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-feffa2e6-d28b-4bb5-8602-cef74a8c0542 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.231825 Dec 15 13:06:21.919478 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 197/443] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:21 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:21.972013 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1e5ff843-48e0-468c-a521-e32a340cf446 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2" status: 204 len: 0 microversion: 2.1 time: 0.182014 Dec 15 13:06:21.976457 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 247/444] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Dec 15 13:06:21 2021] DELETE /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:06:21.984731 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-cc8fb533-a732-4310-aab1-7e9ce5a899a7 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:21.986247 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-cc8fb533-a732-4310-aab1-7e9ce5a899a7 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: c12aa550-5e0a-4766-a6c6-d4acab7281b2] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:21.994272 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cc8fb533-a732-4310-aab1-7e9ce5a899a7 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:21.994712 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cc8fb533-a732-4310-aab1-7e9ce5a899a7 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:21.997082 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cc8fb533-a732-4310-aab1-7e9ce5a899a7 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:21.997082 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cc8fb533-a732-4310-aab1-7e9ce5a899a7 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:22.003899 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-698d96fd-d040-40a8-8879-2fd965b1683b tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:22.004661 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-698d96fd-d040-40a8-8879-2fd965b1683b tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:22.016225 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-698d96fd-d040-40a8-8879-2fd965b1683b tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:22.016726 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-698d96fd-d040-40a8-8879-2fd965b1683b tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:22.017646 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-698d96fd-d040-40a8-8879-2fd965b1683b tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:22.018129 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-698d96fd-d040-40a8-8879-2fd965b1683b tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:22.233812 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-698d96fd-d040-40a8-8879-2fd965b1683b tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:22.244154 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-698d96fd-d040-40a8-8879-2fd965b1683b tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1356 microversion: 2.1 time: 0.244707 Dec 15 13:06:22.255815 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 248/445] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:21 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1356 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:22.262783 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f4f7b723-4aad-4a65-9713-f18377af065f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:22.263466 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f4f7b723-4aad-4a65-9713-f18377af065f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:22.275620 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-cc8fb533-a732-4310-aab1-7e9ce5a899a7 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:22.278079 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f4f7b723-4aad-4a65-9713-f18377af065f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:22.278829 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f4f7b723-4aad-4a65-9713-f18377af065f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:22.279744 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f4f7b723-4aad-4a65-9713-f18377af065f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:22.280257 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f4f7b723-4aad-4a65-9713-f18377af065f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:22.283661 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-cc8fb533-a732-4310-aab1-7e9ce5a899a7 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2" status: 200 len: 1504 microversion: 2.1 time: 0.304902 Dec 15 13:06:22.284960 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 198/446] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:21 2021] GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2 => generated 1504 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:22.477797 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f4f7b723-4aad-4a65-9713-f18377af065f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:22.489654 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f4f7b723-4aad-4a65-9713-f18377af065f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1521 microversion: 2.1 time: 0.231996 Dec 15 13:06:22.490379 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 249/447] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:22 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:22.535350 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-20d785fc-da83-4613-9591-7c3ed5a371f8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:22.536501 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-20d785fc-da83-4613-9591-7c3ed5a371f8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:22.545832 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-20d785fc-da83-4613-9591-7c3ed5a371f8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:22.546332 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-20d785fc-da83-4613-9591-7c3ed5a371f8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:22.547122 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-20d785fc-da83-4613-9591-7c3ed5a371f8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:22.547603 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-20d785fc-da83-4613-9591-7c3ed5a371f8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:22.743253 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-20d785fc-da83-4613-9591-7c3ed5a371f8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:22.758597 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-20d785fc-da83-4613-9591-7c3ed5a371f8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:22.763106 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-20d785fc-da83-4613-9591-7c3ed5a371f8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:22.764312 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-20d785fc-da83-4613-9591-7c3ed5a371f8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1738 microversion: 2.20 time: 0.235427 Dec 15 13:06:22.766356 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 199/448] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:22 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1738 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:06:22.928512 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-cbe80779-3769-4456-ac96-856e8a209657 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:22.929169 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-cbe80779-3769-4456-ac96-856e8a209657 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:22.936044 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cbe80779-3769-4456-ac96-856e8a209657 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:22.936483 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cbe80779-3769-4456-ac96-856e8a209657 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:22.937259 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cbe80779-3769-4456-ac96-856e8a209657 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:22.937688 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cbe80779-3769-4456-ac96-856e8a209657 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:23.097398 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-cbe80779-3769-4456-ac96-856e8a209657 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:23.106078 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-cbe80779-3769-4456-ac96-856e8a209657 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.184204 Dec 15 13:06:23.106760 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 250/449] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:22 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:23.272235 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-9104f68c-44e6-48fc-911b-f917004da55d tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:23.273203 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-9104f68c-44e6-48fc-911b-f917004da55d tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:23.280802 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9104f68c-44e6-48fc-911b-f917004da55d tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:23.282132 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9104f68c-44e6-48fc-911b-f917004da55d tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:23.283438 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9104f68c-44e6-48fc-911b-f917004da55d tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:23.284086 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9104f68c-44e6-48fc-911b-f917004da55d tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:23.301388 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0e05ca17-7bcc-4401-9ab6-395a72399eac tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:23.301926 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0e05ca17-7bcc-4401-9ab6-395a72399eac tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: c12aa550-5e0a-4766-a6c6-d4acab7281b2] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:23.312399 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0e05ca17-7bcc-4401-9ab6-395a72399eac tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:23.313246 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0e05ca17-7bcc-4401-9ab6-395a72399eac tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:23.315062 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0e05ca17-7bcc-4401-9ab6-395a72399eac tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:23.315761 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0e05ca17-7bcc-4401-9ab6-395a72399eac tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:23.454547 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-9104f68c-44e6-48fc-911b-f917004da55d tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:23.463778 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-9104f68c-44e6-48fc-911b-f917004da55d tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1356 microversion: 2.1 time: 0.195741 Dec 15 13:06:23.471119 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 200/450] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:23 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1356 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:23.490642 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0e05ca17-7bcc-4401-9ab6-395a72399eac tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:23.498415 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-0e05ca17-7bcc-4401-9ab6-395a72399eac tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2" status: 200 len: 1504 microversion: 2.1 time: 0.201431 Dec 15 13:06:23.499074 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 251/451] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:23 2021] GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2 => generated 1504 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:23.507824 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-1770657a-ea6b-4005-88dc-6f632eae77d5 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:23.508771 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-1770657a-ea6b-4005-88dc-6f632eae77d5 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:23.515213 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1770657a-ea6b-4005-88dc-6f632eae77d5 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:23.515750 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1770657a-ea6b-4005-88dc-6f632eae77d5 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:23.517296 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1770657a-ea6b-4005-88dc-6f632eae77d5 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:23.518201 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1770657a-ea6b-4005-88dc-6f632eae77d5 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:23.723051 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-1770657a-ea6b-4005-88dc-6f632eae77d5 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:23.732120 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-1770657a-ea6b-4005-88dc-6f632eae77d5 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1521 microversion: 2.1 time: 0.227605 Dec 15 13:06:23.733351 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 201/452] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:23 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:23.785219 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-95eb172b-353e-41ed-a962-36d2991bc993 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:23.786082 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-95eb172b-353e-41ed-a962-36d2991bc993 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:23.795767 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-95eb172b-353e-41ed-a962-36d2991bc993 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:23.795767 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-95eb172b-353e-41ed-a962-36d2991bc993 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:23.796676 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-95eb172b-353e-41ed-a962-36d2991bc993 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:23.797310 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-95eb172b-353e-41ed-a962-36d2991bc993 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:23.947326 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-95eb172b-353e-41ed-a962-36d2991bc993 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:23.955910 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-95eb172b-353e-41ed-a962-36d2991bc993 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:23.957468 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-95eb172b-353e-41ed-a962-36d2991bc993 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:23.958680 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-95eb172b-353e-41ed-a962-36d2991bc993 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1738 microversion: 2.20 time: 0.177776 Dec 15 13:06:23.970581 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 252/453] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:23 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:06:24.124331 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-202e5d3e-ce88-45f1-8bc3-5c3a54b5ee5f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:24.125035 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-202e5d3e-ce88-45f1-8bc3-5c3a54b5ee5f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:24.134332 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-202e5d3e-ce88-45f1-8bc3-5c3a54b5ee5f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:24.134939 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-202e5d3e-ce88-45f1-8bc3-5c3a54b5ee5f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:24.135749 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-202e5d3e-ce88-45f1-8bc3-5c3a54b5ee5f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:24.136192 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-202e5d3e-ce88-45f1-8bc3-5c3a54b5ee5f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:24.289023 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-202e5d3e-ce88-45f1-8bc3-5c3a54b5ee5f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:24.297868 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-202e5d3e-ce88-45f1-8bc3-5c3a54b5ee5f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.177431 Dec 15 13:06:24.298483 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 202/454] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:24 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:24.480176 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5b4675a3-78cb-47be-b5f1-996f816241a3 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:24.480779 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5b4675a3-78cb-47be-b5f1-996f816241a3 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:24.488469 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5b4675a3-78cb-47be-b5f1-996f816241a3 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:24.488915 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5b4675a3-78cb-47be-b5f1-996f816241a3 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:24.489701 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5b4675a3-78cb-47be-b5f1-996f816241a3 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:24.490132 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5b4675a3-78cb-47be-b5f1-996f816241a3 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:24.519052 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-dc0676cd-b04b-4c5a-af90-a1866d65d9ce tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:24.520221 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-dc0676cd-b04b-4c5a-af90-a1866d65d9ce tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: c12aa550-5e0a-4766-a6c6-d4acab7281b2] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:24.527327 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dc0676cd-b04b-4c5a-af90-a1866d65d9ce tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:24.528083 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dc0676cd-b04b-4c5a-af90-a1866d65d9ce tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:24.529052 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dc0676cd-b04b-4c5a-af90-a1866d65d9ce tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:24.529825 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dc0676cd-b04b-4c5a-af90-a1866d65d9ce tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:24.665948 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5b4675a3-78cb-47be-b5f1-996f816241a3 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:24.674244 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5b4675a3-78cb-47be-b5f1-996f816241a3 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1356 microversion: 2.1 time: 0.197475 Dec 15 13:06:24.684181 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 253/455] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:24 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1356 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:24.694832 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-dc0676cd-b04b-4c5a-af90-a1866d65d9ce tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:24.704561 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-dc0676cd-b04b-4c5a-af90-a1866d65d9ce tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2" status: 200 len: 1504 microversion: 2.1 time: 0.189279 Dec 15 13:06:24.714841 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 203/456] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:24 2021] GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2 => generated 1504 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:24.756293 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-782eb38d-e43e-4112-a511-66abd33e3e6a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:24.758346 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-782eb38d-e43e-4112-a511-66abd33e3e6a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:24.775207 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-782eb38d-e43e-4112-a511-66abd33e3e6a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:24.775207 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-782eb38d-e43e-4112-a511-66abd33e3e6a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:24.775207 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-782eb38d-e43e-4112-a511-66abd33e3e6a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:24.775207 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-782eb38d-e43e-4112-a511-66abd33e3e6a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:24.960712 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-782eb38d-e43e-4112-a511-66abd33e3e6a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:24.971238 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-782eb38d-e43e-4112-a511-66abd33e3e6a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1521 microversion: 2.1 time: 0.221592 Dec 15 13:06:24.978391 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 254/457] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:24 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:24.978882 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-0745fe75-ba33-455b-baf5-4ba430f3bc6f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:24.979592 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-0745fe75-ba33-455b-baf5-4ba430f3bc6f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:24.987417 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0745fe75-ba33-455b-baf5-4ba430f3bc6f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:24.987887 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0745fe75-ba33-455b-baf5-4ba430f3bc6f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:24.988698 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0745fe75-ba33-455b-baf5-4ba430f3bc6f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:24.989137 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0745fe75-ba33-455b-baf5-4ba430f3bc6f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:25.137197 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-0745fe75-ba33-455b-baf5-4ba430f3bc6f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:25.147024 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-0745fe75-ba33-455b-baf5-4ba430f3bc6f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:25.148535 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-0745fe75-ba33-455b-baf5-4ba430f3bc6f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:25.149712 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-0745fe75-ba33-455b-baf5-4ba430f3bc6f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1738 microversion: 2.20 time: 0.174593 Dec 15 13:06:25.150302 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 204/458] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:24 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:06:25.316173 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-2b7a55fa-3845-4da1-8c7b-4d8e159dfac7 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:25.316981 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-2b7a55fa-3845-4da1-8c7b-4d8e159dfac7 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:25.324185 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2b7a55fa-3845-4da1-8c7b-4d8e159dfac7 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:25.324704 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2b7a55fa-3845-4da1-8c7b-4d8e159dfac7 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:25.325574 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2b7a55fa-3845-4da1-8c7b-4d8e159dfac7 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:25.326072 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2b7a55fa-3845-4da1-8c7b-4d8e159dfac7 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:25.475821 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-2b7a55fa-3845-4da1-8c7b-4d8e159dfac7 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:25.486626 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-2b7a55fa-3845-4da1-8c7b-4d8e159dfac7 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.174601 Dec 15 13:06:25.496550 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 255/459] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:25 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:25.692504 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-60db8c17-0de3-4b1c-b8cb-9743755193cd tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:25.693252 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-60db8c17-0de3-4b1c-b8cb-9743755193cd tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:25.700205 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-60db8c17-0de3-4b1c-b8cb-9743755193cd tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:25.700648 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-60db8c17-0de3-4b1c-b8cb-9743755193cd tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:25.701644 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-60db8c17-0de3-4b1c-b8cb-9743755193cd tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:25.702078 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-60db8c17-0de3-4b1c-b8cb-9743755193cd tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:25.721791 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4ccab8c5-e92c-431e-a1ff-182e98f99e7c tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:25.723114 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4ccab8c5-e92c-431e-a1ff-182e98f99e7c tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: c12aa550-5e0a-4766-a6c6-d4acab7281b2] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:25.731381 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4ccab8c5-e92c-431e-a1ff-182e98f99e7c tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:25.732014 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4ccab8c5-e92c-431e-a1ff-182e98f99e7c tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:25.732757 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4ccab8c5-e92c-431e-a1ff-182e98f99e7c tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:25.733212 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4ccab8c5-e92c-431e-a1ff-182e98f99e7c tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:25.880296 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-60db8c17-0de3-4b1c-b8cb-9743755193cd tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:25.896681 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-60db8c17-0de3-4b1c-b8cb-9743755193cd tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1356 microversion: 2.1 time: 0.208058 Dec 15 13:06:25.906470 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 205/460] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:25 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1356 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:25.988324 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4ccab8c5-e92c-431e-a1ff-182e98f99e7c tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:25.992734 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-9385c444-8998-4d44-8519-95650727637c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:25.994522 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-9385c444-8998-4d44-8519-95650727637c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:26.007488 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4ccab8c5-e92c-431e-a1ff-182e98f99e7c tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2" status: 200 len: 1504 microversion: 2.1 time: 0.288836 Dec 15 13:06:26.022177 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9385c444-8998-4d44-8519-95650727637c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:26.022177 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9385c444-8998-4d44-8519-95650727637c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:26.022177 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9385c444-8998-4d44-8519-95650727637c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:26.022605 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 256/461] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:25 2021] GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2 => generated 1504 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:26.022800 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9385c444-8998-4d44-8519-95650727637c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:26.167959 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ebba821d-ffa4-4562-9a72-23d30cf600d5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:26.169185 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ebba821d-ffa4-4562-9a72-23d30cf600d5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:26.179220 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ebba821d-ffa4-4562-9a72-23d30cf600d5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:26.179807 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ebba821d-ffa4-4562-9a72-23d30cf600d5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:26.180763 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ebba821d-ffa4-4562-9a72-23d30cf600d5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:26.181435 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ebba821d-ffa4-4562-9a72-23d30cf600d5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:26.370903 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ebba821d-ffa4-4562-9a72-23d30cf600d5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:26.380525 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ebba821d-ffa4-4562-9a72-23d30cf600d5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:26.382140 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ebba821d-ffa4-4562-9a72-23d30cf600d5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:26.383240 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ebba821d-ffa4-4562-9a72-23d30cf600d5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1738 microversion: 2.20 time: 0.218916 Dec 15 13:06:26.383945 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 257/462] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:26 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1738 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:06:26.385823 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-9385c444-8998-4d44-8519-95650727637c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:26.402659 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-9385c444-8998-4d44-8519-95650727637c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1521 microversion: 2.1 time: 0.418293 Dec 15 13:06:26.412694 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 206/463] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:25 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1521 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:26.505441 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0f9ebcf5-dccf-46bb-8403-4253003f351f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:26.506881 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0f9ebcf5-dccf-46bb-8403-4253003f351f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:26.513316 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0f9ebcf5-dccf-46bb-8403-4253003f351f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:26.517690 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0f9ebcf5-dccf-46bb-8403-4253003f351f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:26.520347 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0f9ebcf5-dccf-46bb-8403-4253003f351f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:26.520963 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0f9ebcf5-dccf-46bb-8403-4253003f351f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:26.693058 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0f9ebcf5-dccf-46bb-8403-4253003f351f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:26.704663 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-0f9ebcf5-dccf-46bb-8403-4253003f351f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.203627 Dec 15 13:06:26.716356 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 258/464] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:26 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:26.914290 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-9a24eb84-5dd2-4a3d-8733-db3acecded01 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:26.914924 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-9a24eb84-5dd2-4a3d-8733-db3acecded01 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:26.932873 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9a24eb84-5dd2-4a3d-8733-db3acecded01 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:26.933574 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9a24eb84-5dd2-4a3d-8733-db3acecded01 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:26.934957 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9a24eb84-5dd2-4a3d-8733-db3acecded01 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:26.936602 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9a24eb84-5dd2-4a3d-8733-db3acecded01 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:26.974074 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-9e453aa7-fd9c-4c4d-b2da-9b6ed1b16464 req-d101431b-d6eb-49b6-995b-c2019d36058b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c12aa550-5e0a-4766-a6c6-d4acab7281b2", "name": "network-vif-deleted", "tag": "7f82aa8d-7466-43ba-8f47-e9dc62d74365"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:06:26.978959 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:06:26.978959 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:06:26.990748 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-9e453aa7-fd9c-4c4d-b2da-9b6ed1b16464 req-d101431b-d6eb-49b6-995b-c2019d36058b service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:26.991669 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-9e453aa7-fd9c-4c4d-b2da-9b6ed1b16464 req-d101431b-d6eb-49b6-995b-c2019d36058b service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:27.005979 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-9e453aa7-fd9c-4c4d-b2da-9b6ed1b16464 req-d101431b-d6eb-49b6-995b-c2019d36058b service nova] Creating event network-vif-deleted:7f82aa8d-7466-43ba-8f47-e9dc62d74365 for instance c12aa550-5e0a-4766-a6c6-d4acab7281b2 on hv-cinder-81322 Dec 15 13:06:27.011603 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-9e453aa7-fd9c-4c4d-b2da-9b6ed1b16464 req-d101431b-d6eb-49b6-995b-c2019d36058b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044486 Dec 15 13:06:27.012759 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 259/465] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:06:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:06:27.044957 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-df4199d1-5597-4ad3-bf21-84edb7da1419 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:27.046418 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-df4199d1-5597-4ad3-bf21-84edb7da1419 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: c12aa550-5e0a-4766-a6c6-d4acab7281b2] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:27.054444 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-df4199d1-5597-4ad3-bf21-84edb7da1419 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:27.054991 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-df4199d1-5597-4ad3-bf21-84edb7da1419 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:27.055863 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-df4199d1-5597-4ad3-bf21-84edb7da1419 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:27.056339 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-df4199d1-5597-4ad3-bf21-84edb7da1419 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:27.199766 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-df4199d1-5597-4ad3-bf21-84edb7da1419 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:27.211451 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-df4199d1-5597-4ad3-bf21-84edb7da1419 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2" status: 200 len: 1299 microversion: 2.1 time: 0.170955 Dec 15 13:06:27.212219 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 260/466] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:27 2021] GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2 => generated 1299 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:27.251383 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-9a24eb84-5dd2-4a3d-8733-db3acecded01 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:27.273656 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-9a24eb84-5dd2-4a3d-8733-db3acecded01 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1356 microversion: 2.1 time: 0.363213 Dec 15 13:06:27.282822 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 207/467] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:26 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1356 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:27.404849 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-fab8bebf-1fcf-46a5-a5e3-117285ec6295 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:27.405341 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-fab8bebf-1fcf-46a5-a5e3-117285ec6295 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:27.412775 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fab8bebf-1fcf-46a5-a5e3-117285ec6295 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:27.413297 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fab8bebf-1fcf-46a5-a5e3-117285ec6295 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:27.414386 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fab8bebf-1fcf-46a5-a5e3-117285ec6295 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:27.414866 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fab8bebf-1fcf-46a5-a5e3-117285ec6295 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:27.419955 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-daca2ced-96b7-46b8-b7ad-1d746f01fcac tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:27.420905 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-daca2ced-96b7-46b8-b7ad-1d746f01fcac tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:27.433335 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-daca2ced-96b7-46b8-b7ad-1d746f01fcac tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:27.433928 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-daca2ced-96b7-46b8-b7ad-1d746f01fcac tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:27.437566 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-daca2ced-96b7-46b8-b7ad-1d746f01fcac tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:27.438388 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-daca2ced-96b7-46b8-b7ad-1d746f01fcac tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:27.687964 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-daca2ced-96b7-46b8-b7ad-1d746f01fcac tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:27.708226 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-daca2ced-96b7-46b8-b7ad-1d746f01fcac tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1521 microversion: 2.1 time: 0.282917 Dec 15 13:06:27.720272 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 208/468] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:27 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:27.730064 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-fab8bebf-1fcf-46a5-a5e3-117285ec6295 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:27.745192 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-fab8bebf-1fcf-46a5-a5e3-117285ec6295 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:27.752226 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-9942ab8d-3999-4f8d-8079-af4632137539 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:27.754306 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-fab8bebf-1fcf-46a5-a5e3-117285ec6295 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:27.754709 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-9942ab8d-3999-4f8d-8079-af4632137539 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:27.757116 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-fab8bebf-1fcf-46a5-a5e3-117285ec6295 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1738 microversion: 2.20 time: 0.356517 Dec 15 13:06:27.760809 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 261/469] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:27 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1738 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:06:27.763263 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9942ab8d-3999-4f8d-8079-af4632137539 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:27.763850 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9942ab8d-3999-4f8d-8079-af4632137539 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:27.764883 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9942ab8d-3999-4f8d-8079-af4632137539 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:27.765370 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9942ab8d-3999-4f8d-8079-af4632137539 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:27.913710 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-e736ae6c-2caf-4cb4-890d-7ef127df500e req-9d459fc5-8e09-47e4-a128-73ce08fe5bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b62c709-a647-468b-bb79-1e1e20832c1e", "name": "network-vif-plugged", "status": "completed", "tag": "235d69ca-304f-4a79-a570-8c3fd9220dcf"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:06:27.916074 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:06:27.916074 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:06:27.976543 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-e736ae6c-2caf-4cb4-890d-7ef127df500e req-9d459fc5-8e09-47e4-a128-73ce08fe5bb5 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:27.979332 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-e736ae6c-2caf-4cb4-890d-7ef127df500e req-9d459fc5-8e09-47e4-a128-73ce08fe5bb5 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:28.044598 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-e736ae6c-2caf-4cb4-890d-7ef127df500e req-9d459fc5-8e09-47e4-a128-73ce08fe5bb5 service nova] Creating event network-vif-plugged:235d69ca-304f-4a79-a570-8c3fd9220dcf for instance 5b62c709-a647-468b-bb79-1e1e20832c1e on hv-cinder-81322 Dec 15 13:06:28.050756 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-e736ae6c-2caf-4cb4-890d-7ef127df500e req-9d459fc5-8e09-47e4-a128-73ce08fe5bb5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150241 Dec 15 13:06:28.065943 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-9942ab8d-3999-4f8d-8079-af4632137539 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:28.071385 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 262/470] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:06:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:06:28.095485 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-9942ab8d-3999-4f8d-8079-af4632137539 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.374385 Dec 15 13:06:28.097408 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 209/471] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:27 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:28.229329 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0836f5fb-b72f-4d23-9ddf-c5d63a241311 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:28.230081 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0836f5fb-b72f-4d23-9ddf-c5d63a241311 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: c12aa550-5e0a-4766-a6c6-d4acab7281b2] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:28.237187 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0836f5fb-b72f-4d23-9ddf-c5d63a241311 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:28.237732 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0836f5fb-b72f-4d23-9ddf-c5d63a241311 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:28.238585 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0836f5fb-b72f-4d23-9ddf-c5d63a241311 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:28.239020 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0836f5fb-b72f-4d23-9ddf-c5d63a241311 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:28.254843 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-0836f5fb-b72f-4d23-9ddf-c5d63a241311 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] HTTP exception thrown: Instance c12aa550-5e0a-4766-a6c6-d4acab7281b2 could not be found. Dec 15 13:06:28.255622 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0836f5fb-b72f-4d23-9ddf-c5d63a241311 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Returning 404 to user: Instance c12aa550-5e0a-4766-a6c6-d4acab7281b2 could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:06:28.256639 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-0836f5fb-b72f-4d23-9ddf-c5d63a241311 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2" status: 404 len: 111 microversion: 2.1 time: 0.031451 Dec 15 13:06:28.257449 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 263/472] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:28 2021] GET /compute/v2.1/servers/c12aa550-5e0a-4766-a6c6-d4acab7281b2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:06:28.292927 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-29311ea9-810e-41f7-8936-b27a8a5e5dbe tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:28.293546 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-29311ea9-810e-41f7-8936-b27a8a5e5dbe tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:28.309692 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-29311ea9-810e-41f7-8936-b27a8a5e5dbe tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:28.310249 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-29311ea9-810e-41f7-8936-b27a8a5e5dbe tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:28.311082 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-29311ea9-810e-41f7-8936-b27a8a5e5dbe tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:28.311528 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-29311ea9-810e-41f7-8936-b27a8a5e5dbe tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:28.419308 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a2529011-02d7-4db4-9b7f-313d0c619fd2 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-977047097", "imageRef": "67890983-693f-44ed-bdf3-22321abeab26", "flavorRef": "452", "networks": [{"uuid": "77daa3e7-bccf-46d5-b95b-c14f96e66d13"}]}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:06:28.487727 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.network.neutron [None req-a2529011-02d7-4db4-9b7f-313d0c619fd2 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] validate_networks() for [('77daa3e7-bccf-46d5-b95b-c14f96e66d13', None, None, None, None, None)] {{(pid=116098) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:06:28.549929 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-29311ea9-810e-41f7-8936-b27a8a5e5dbe tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:28.559526 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-29311ea9-810e-41f7-8936-b27a8a5e5dbe tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1356 microversion: 2.1 time: 0.270391 Dec 15 13:06:28.560104 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 210/473] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:28 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1356 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:28.727394 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-0081d933-a624-449b-b807-395223dfe66a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:28.728088 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-0081d933-a624-449b-b807-395223dfe66a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:28.736836 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0081d933-a624-449b-b807-395223dfe66a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:28.737841 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0081d933-a624-449b-b807-395223dfe66a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:28.739423 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0081d933-a624-449b-b807-395223dfe66a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:28.740246 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0081d933-a624-449b-b807-395223dfe66a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:28.965316 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-a2529011-02d7-4db4-9b7f-313d0c619fd2 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Flavor limits 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:06:28.966218 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-a2529011-02d7-4db4-9b7f-313d0c619fd2 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Image limits 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:06:28.967335 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-a2529011-02d7-4db4-9b7f-313d0c619fd2 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Flavor pref 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:06:28.968179 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-a2529011-02d7-4db4-9b7f-313d0c619fd2 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Image pref 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:06:28.968865 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-a2529011-02d7-4db4-9b7f-313d0c619fd2 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:06:28.990745 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a2529011-02d7-4db4-9b7f-313d0c619fd2 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:28.991987 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a2529011-02d7-4db4-9b7f-313d0c619fd2 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:28.993033 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a2529011-02d7-4db4-9b7f-313d0c619fd2 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:28.993640 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a2529011-02d7-4db4-9b7f-313d0c619fd2 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:29.010782 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-0081d933-a624-449b-b807-395223dfe66a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:29.025610 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-0081d933-a624-449b-b807-395223dfe66a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1521 microversion: 2.1 time: 0.302548 Dec 15 13:06:29.026644 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 211/474] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:28 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:29.027972 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-a2529011-02d7-4db4-9b7f-313d0c619fd2 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Getting quotas for project b46bbc0bed7d4240b988cedfca33d196. Resources: {'instances', 'cores', 'ram'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:06:29.034007 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-a2529011-02d7-4db4-9b7f-313d0c619fd2 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Getting quotas for user f5db27c491ee4002854039f9e53f52af and project b46bbc0bed7d4240b988cedfca33d196. Resources: {'instances', 'cores', 'ram'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:06:29.042074 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-369340a8-3e0e-4f13-810b-0a15ab7fbe00 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:29.044058 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-369340a8-3e0e-4f13-810b-0a15ab7fbe00 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:29.055085 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-369340a8-3e0e-4f13-810b-0a15ab7fbe00 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:29.056009 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-369340a8-3e0e-4f13-810b-0a15ab7fbe00 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:29.056731 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a2529011-02d7-4db4-9b7f-313d0c619fd2 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Going to run 1 instances... {{(pid=116098) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:06:29.057242 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-369340a8-3e0e-4f13-810b-0a15ab7fbe00 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:29.058257 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-369340a8-3e0e-4f13-810b-0a15ab7fbe00 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:29.060988 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a2529011-02d7-4db4-9b7f-313d0c619fd2 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67890983-693f-44ed-bdf3-22321abeab26',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:06:29.129337 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a2529011-02d7-4db4-9b7f-313d0c619fd2 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.714669 Dec 15 13:06:29.136135 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 264/475] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Dec 15 13:06:28 2021] POST /compute/v2.1/servers => generated 380 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 13:06:29.144048 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ac059f4c-abe8-437c-b3ee-b63f31bdaafc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:29.144969 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ac059f4c-abe8-437c-b3ee-b63f31bdaafc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:29.152604 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ac059f4c-abe8-437c-b3ee-b63f31bdaafc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:29.153061 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ac059f4c-abe8-437c-b3ee-b63f31bdaafc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:29.155562 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ac059f4c-abe8-437c-b3ee-b63f31bdaafc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:29.157076 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ac059f4c-abe8-437c-b3ee-b63f31bdaafc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:29.298401 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-369340a8-3e0e-4f13-810b-0a15ab7fbe00 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:29.308417 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-369340a8-3e0e-4f13-810b-0a15ab7fbe00 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:29.314169 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-369340a8-3e0e-4f13-810b-0a15ab7fbe00 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:29.315606 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-369340a8-3e0e-4f13-810b-0a15ab7fbe00 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1738 microversion: 2.20 time: 0.287683 Dec 15 13:06:29.322306 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 212/476] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:29 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1738 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:06:29.331553 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-74cf88b3-7fe5-4857-a068-2be0a9149766 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:29.332689 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-74cf88b3-7fe5-4857-a068-2be0a9149766 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:29.383960 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ac059f4c-abe8-437c-b3ee-b63f31bdaafc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:29.395301 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ac059f4c-abe8-437c-b3ee-b63f31bdaafc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.257562 Dec 15 13:06:29.395880 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 265/477] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:29 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:29.400775 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-bb9a37bb-dd62-40e2-9e31-1a3a80980be4 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "377d38d0-67fd-42f8-88ef-054b3cd71eed"}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:06:29.402081 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-bb9a37bb-dd62-40e2-9e31-1a3a80980be4 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:29.412546 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bb9a37bb-dd62-40e2-9e31-1a3a80980be4 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:29.413123 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bb9a37bb-dd62-40e2-9e31-1a3a80980be4 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:29.414035 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bb9a37bb-dd62-40e2-9e31-1a3a80980be4 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:29.414562 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bb9a37bb-dd62-40e2-9e31-1a3a80980be4 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:29.419054 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-74cf88b3-7fe5-4857-a068-2be0a9149766 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:29.429152 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-74cf88b3-7fe5-4857-a068-2be0a9149766 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1213 microversion: 2.1 time: 0.105147 Dec 15 13:06:29.429917 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 213/478] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:29 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1213 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:29.523245 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-bb9a37bb-dd62-40e2-9e31-1a3a80980be4 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] HTTP exception thrown: Invalid volume: volume 377d38d0-67fd-42f8-88ef-054b3cd71eed is already attached to instances: e5b657b8-e2d6-4365-b369-0accd054202d Dec 15 13:06:29.523846 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-bb9a37bb-dd62-40e2-9e31-1a3a80980be4 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Returning 400 to user: Invalid volume: volume 377d38d0-67fd-42f8-88ef-054b3cd71eed is already attached to instances: e5b657b8-e2d6-4365-b369-0accd054202d {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:06:29.524691 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-bb9a37bb-dd62-40e2-9e31-1a3a80980be4 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "POST /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.127674 Dec 15 13:06:29.525534 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 266/479] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Dec 15 13:06:29 2021] POST /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d/os-volume_attachments => generated 174 bytes in 129 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:06:29.576430 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-0836a508-f8c5-497e-bf17-e87aaf2be691 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:29.577039 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-0836a508-f8c5-497e-bf17-e87aaf2be691 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:29.587653 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0836a508-f8c5-497e-bf17-e87aaf2be691 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:29.588102 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0836a508-f8c5-497e-bf17-e87aaf2be691 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:29.588886 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0836a508-f8c5-497e-bf17-e87aaf2be691 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:29.589315 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0836a508-f8c5-497e-bf17-e87aaf2be691 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:29.598873 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b3133608-3b55-45d9-8a47-13b4bc9c4adb tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:29.599943 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b3133608-3b55-45d9-8a47-13b4bc9c4adb tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:29.612065 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b3133608-3b55-45d9-8a47-13b4bc9c4adb tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:29.612888 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b3133608-3b55-45d9-8a47-13b4bc9c4adb tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:29.614062 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b3133608-3b55-45d9-8a47-13b4bc9c4adb tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:29.615333 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b3133608-3b55-45d9-8a47-13b4bc9c4adb tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:29.758356 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-0836a508-f8c5-497e-bf17-e87aaf2be691 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:29.769716 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-0836a508-f8c5-497e-bf17-e87aaf2be691 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1356 microversion: 2.1 time: 0.196726 Dec 15 13:06:29.770574 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 214/480] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:29 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1356 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:29.783755 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.objects.instance [None req-b3133608-3b55-45d9-8a47-13b4bc9c4adb tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lazy-loading 'services' on Instance uuid e5b657b8-e2d6-4365-b369-0accd054202d {{(pid=116098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:06:29.791196 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-6468c1ee-32d1-485f-a087-2ff6cdafbc35 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:29.791980 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-6468c1ee-32d1-485f-a087-2ff6cdafbc35 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: 6d7e8b60-2efb-4376-ab88-65f915ebd89f] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:29.814866 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6468c1ee-32d1-485f-a087-2ff6cdafbc35 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:29.815514 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6468c1ee-32d1-485f-a087-2ff6cdafbc35 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:29.816460 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6468c1ee-32d1-485f-a087-2ff6cdafbc35 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:29.817112 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6468c1ee-32d1-485f-a087-2ff6cdafbc35 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:29.944864 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.objects.instance [None req-6468c1ee-32d1-485f-a087-2ff6cdafbc35 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lazy-loading 'services' on Instance uuid 6d7e8b60-2efb-4376-ab88-65f915ebd89f {{(pid=116097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:06:29.971147 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b3133608-3b55-45d9-8a47-13b4bc9c4adb tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d/os-volume_attachments/377d38d0-67fd-42f8-88ef-054b3cd71eed" status: 202 len: 0 microversion: 2.1 time: 0.378978 Dec 15 13:06:29.976346 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 267/481] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Dec 15 13:06:29 2021] DELETE /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d/os-volume_attachments/377d38d0-67fd-42f8-88ef-054b3cd71eed => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:06:29.982574 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f4d8b0db-0a08-45fd-8574-838c67ec18c7 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:29.983587 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f4d8b0db-0a08-45fd-8574-838c67ec18c7 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:29.990023 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f4d8b0db-0a08-45fd-8574-838c67ec18c7 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:29.990512 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f4d8b0db-0a08-45fd-8574-838c67ec18c7 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:29.991294 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f4d8b0db-0a08-45fd-8574-838c67ec18c7 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:29.991856 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f4d8b0db-0a08-45fd-8574-838c67ec18c7 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:30.035634 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-6468c1ee-32d1-485f-a087-2ff6cdafbc35 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f/os-volume_attachments/2bcdb87a-e773-463f-96a4-b5b2ac4256c5" status: 202 len: 0 microversion: 2.1 time: 0.248419 Dec 15 13:06:30.036860 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 215/482] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Dec 15 13:06:29 2021] DELETE /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f/os-volume_attachments/2bcdb87a-e773-463f-96a4-b5b2ac4256c5 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:06:30.045761 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-b0741233-9113-43b3-9cfd-f6d05aff05de tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:30.046810 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-b0741233-9113-43b3-9cfd-f6d05aff05de tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:30.049145 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f4d8b0db-0a08-45fd-8574-838c67ec18c7 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072246 Dec 15 13:06:30.049779 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 268/483] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:06:29 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:06:30.054697 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b0741233-9113-43b3-9cfd-f6d05aff05de tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:30.055224 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b0741233-9113-43b3-9cfd-f6d05aff05de tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:30.056029 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b0741233-9113-43b3-9cfd-f6d05aff05de tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:30.056469 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b0741233-9113-43b3-9cfd-f6d05aff05de tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:30.199890 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-b0741233-9113-43b3-9cfd-f6d05aff05de tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:30.209006 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-b0741233-9113-43b3-9cfd-f6d05aff05de tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1521 microversion: 2.1 time: 0.167601 Dec 15 13:06:30.209575 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 216/484] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:30 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:30.333494 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ba90027e-dc76-4147-b1de-d2c11efc4d01 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:30.334447 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ba90027e-dc76-4147-b1de-d2c11efc4d01 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:30.340459 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ba90027e-dc76-4147-b1de-d2c11efc4d01 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:30.340898 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ba90027e-dc76-4147-b1de-d2c11efc4d01 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:30.341655 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ba90027e-dc76-4147-b1de-d2c11efc4d01 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:30.342083 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ba90027e-dc76-4147-b1de-d2c11efc4d01 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:30.413600 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-548cda45-ea5b-43ad-a23c-28c66ca8d7e3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:30.415121 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-548cda45-ea5b-43ad-a23c-28c66ca8d7e3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:30.422700 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-548cda45-ea5b-43ad-a23c-28c66ca8d7e3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:30.423478 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-548cda45-ea5b-43ad-a23c-28c66ca8d7e3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:30.424012 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-548cda45-ea5b-43ad-a23c-28c66ca8d7e3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:30.430600 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-548cda45-ea5b-43ad-a23c-28c66ca8d7e3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:30.477259 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ba90027e-dc76-4147-b1de-d2c11efc4d01 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:30.490895 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ba90027e-dc76-4147-b1de-d2c11efc4d01 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:30.492604 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ba90027e-dc76-4147-b1de-d2c11efc4d01 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:30.493972 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ba90027e-dc76-4147-b1de-d2c11efc4d01 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1738 microversion: 2.20 time: 0.164047 Dec 15 13:06:30.495175 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 269/485] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:30 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:06:30.501835 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c4fd06c2-5db5-4d65-89b2-dd8195bc5230 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:30.502541 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c4fd06c2-5db5-4d65-89b2-dd8195bc5230 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:30.509967 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c4fd06c2-5db5-4d65-89b2-dd8195bc5230 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:30.510520 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c4fd06c2-5db5-4d65-89b2-dd8195bc5230 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:30.511318 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c4fd06c2-5db5-4d65-89b2-dd8195bc5230 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:30.511758 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c4fd06c2-5db5-4d65-89b2-dd8195bc5230 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:30.569128 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-548cda45-ea5b-43ad-a23c-28c66ca8d7e3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:30.572083 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c4fd06c2-5db5-4d65-89b2-dd8195bc5230 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:30.576976 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-548cda45-ea5b-43ad-a23c-28c66ca8d7e3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.167804 Dec 15 13:06:30.577540 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 217/486] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:30 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:30.580417 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c4fd06c2-5db5-4d65-89b2-dd8195bc5230 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1265 microversion: 2.1 time: 0.084366 Dec 15 13:06:30.580974 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 270/487] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:30 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:30.788741 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-640bdd4d-caff-4542-8106-1b34eff9c1c0 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:30.789439 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-640bdd4d-caff-4542-8106-1b34eff9c1c0 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:30.795962 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-640bdd4d-caff-4542-8106-1b34eff9c1c0 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:30.796458 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-640bdd4d-caff-4542-8106-1b34eff9c1c0 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:30.797302 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-640bdd4d-caff-4542-8106-1b34eff9c1c0 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:30.797810 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-640bdd4d-caff-4542-8106-1b34eff9c1c0 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:30.929901 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-640bdd4d-caff-4542-8106-1b34eff9c1c0 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:30.938678 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-640bdd4d-caff-4542-8106-1b34eff9c1c0 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1546 microversion: 2.1 time: 0.154575 Dec 15 13:06:30.939231 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 218/488] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:30 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:30.957120 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b72a1889-ca37-42fa-b220-6a8421db8b88 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:30.957731 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b72a1889-ca37-42fa-b220-6a8421db8b88 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:30.963781 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b72a1889-ca37-42fa-b220-6a8421db8b88 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:30.964225 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b72a1889-ca37-42fa-b220-6a8421db8b88 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:30.965099 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b72a1889-ca37-42fa-b220-6a8421db8b88 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:30.965428 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b72a1889-ca37-42fa-b220-6a8421db8b88 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:31.062254 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-a92c6d64-4c6f-4259-9853-a517f26d3728 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:31.064153 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-a92c6d64-4c6f-4259-9853-a517f26d3728 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:31.070342 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a92c6d64-4c6f-4259-9853-a517f26d3728 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:31.071023 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a92c6d64-4c6f-4259-9853-a517f26d3728 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:31.071806 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a92c6d64-4c6f-4259-9853-a517f26d3728 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:31.072239 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a92c6d64-4c6f-4259-9853-a517f26d3728 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:31.111234 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-a92c6d64-4c6f-4259-9853-a517f26d3728 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053550 Dec 15 13:06:31.111626 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b72a1889-ca37-42fa-b220-6a8421db8b88 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:31.117377 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 219/489] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:06:31 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:06:31.121657 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b72a1889-ca37-42fa-b220-6a8421db8b88 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1546 microversion: 2.1 time: 0.168333 Dec 15 13:06:31.122564 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 271/490] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:30 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1546 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:31.138834 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-5204b090-dcd5-4b9a-b4e1-7f262d4afad9 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:31.142862 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:06:31.142862 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:06:31.144228 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-5204b090-dcd5-4b9a-b4e1-7f262d4afad9 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:31.145469 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-5204b090-dcd5-4b9a-b4e1-7f262d4afad9 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Searching by: {'deleted': False, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0'} {{(pid=116097) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 15 13:06:31.151418 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5204b090-dcd5-4b9a-b4e1-7f262d4afad9 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:31.151853 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5204b090-dcd5-4b9a-b4e1-7f262d4afad9 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:31.152718 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5204b090-dcd5-4b9a-b4e1-7f262d4afad9 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:31.153080 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5204b090-dcd5-4b9a-b4e1-7f262d4afad9 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:31.228424 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-82105f90-dfeb-4758-aae3-81ac7916931d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:31.229135 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-82105f90-dfeb-4758-aae3-81ac7916931d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:31.240967 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-82105f90-dfeb-4758-aae3-81ac7916931d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:31.241486 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-82105f90-dfeb-4758-aae3-81ac7916931d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:31.242348 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-82105f90-dfeb-4758-aae3-81ac7916931d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:31.243290 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-82105f90-dfeb-4758-aae3-81ac7916931d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:31.246721 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.multi_cell_list [None req-5204b090-dcd5-4b9a-b4e1-7f262d4afad9 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116097) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 15 13:06:31.400611 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-5204b090-dcd5-4b9a-b4e1-7f262d4afad9 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.265751 Dec 15 13:06:31.403819 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 220/491] 10.222.0.57 () {58 vars in 1124 bytes} [Wed Dec 15 13:06:31 2021] GET /compute/v2.1/servers => generated 342 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:06:31.425832 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-7b2a96be-a16a-40b0-93b8-efae036c9c69 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:31.436507 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-7b2a96be-a16a-40b0-93b8-efae036c9c69 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:31.456069 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7b2a96be-a16a-40b0-93b8-efae036c9c69 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:31.456521 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7b2a96be-a16a-40b0-93b8-efae036c9c69 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:31.457323 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7b2a96be-a16a-40b0-93b8-efae036c9c69 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:31.457763 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7b2a96be-a16a-40b0-93b8-efae036c9c69 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:31.526416 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-82105f90-dfeb-4758-aae3-81ac7916931d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:31.542262 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-82105f90-dfeb-4758-aae3-81ac7916931d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1521 microversion: 2.1 time: 0.319108 Dec 15 13:06:31.543254 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 272/492] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:31 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:31.548283 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c155006a-a88a-4bdd-a48c-f4631338abff tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:31.550720 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c155006a-a88a-4bdd-a48c-f4631338abff tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:31.568023 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c155006a-a88a-4bdd-a48c-f4631338abff tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:31.568688 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c155006a-a88a-4bdd-a48c-f4631338abff tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:31.569642 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c155006a-a88a-4bdd-a48c-f4631338abff tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:31.570273 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c155006a-a88a-4bdd-a48c-f4631338abff tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:31.744440 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-7b2a96be-a16a-40b0-93b8-efae036c9c69 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:31.753885 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-7b2a96be-a16a-40b0-93b8-efae036c9c69 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1546 microversion: 2.1 time: 0.344615 Dec 15 13:06:31.754928 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 221/493] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:31 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1546 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:31.759447 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-e44dabd7-3f38-4075-bd09-99d64b2f0af3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:31.760238 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-e44dabd7-3f38-4075-bd09-99d64b2f0af3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:31.767506 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e44dabd7-3f38-4075-bd09-99d64b2f0af3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:31.768377 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e44dabd7-3f38-4075-bd09-99d64b2f0af3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:31.769512 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e44dabd7-3f38-4075-bd09-99d64b2f0af3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:31.779778 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e44dabd7-3f38-4075-bd09-99d64b2f0af3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:31.863785 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c155006a-a88a-4bdd-a48c-f4631338abff tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:31.876547 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c155006a-a88a-4bdd-a48c-f4631338abff tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:31.879034 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c155006a-a88a-4bdd-a48c-f4631338abff tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:31.881080 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c155006a-a88a-4bdd-a48c-f4631338abff tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1720 microversion: 2.20 time: 0.336614 Dec 15 13:06:31.893047 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 273/494] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:31 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1720 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:06:31.899002 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-aa1cfb24-fb9f-44d4-bd85-2fb55bebc98f tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:31.900375 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-aa1cfb24-fb9f-44d4-bd85-2fb55bebc98f tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:31.916495 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-aa1cfb24-fb9f-44d4-bd85-2fb55bebc98f tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:31.916948 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-aa1cfb24-fb9f-44d4-bd85-2fb55bebc98f tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:31.919495 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-aa1cfb24-fb9f-44d4-bd85-2fb55bebc98f tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:31.919940 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-aa1cfb24-fb9f-44d4-bd85-2fb55bebc98f tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:32.019539 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-e44dabd7-3f38-4075-bd09-99d64b2f0af3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:32.027877 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-e44dabd7-3f38-4075-bd09-99d64b2f0af3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.271730 Dec 15 13:06:32.028456 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 222/495] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:31 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:32.040848 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-aa1cfb24-fb9f-44d4-bd85-2fb55bebc98f tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:32.049564 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-aa1cfb24-fb9f-44d4-bd85-2fb55bebc98f tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1271 microversion: 2.1 time: 0.160572 Dec 15 13:06:32.050537 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 274/496] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:31 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1271 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:32.125197 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-9cbc96ef-1673-4826-801f-193783383cf2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:32.126124 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-9cbc96ef-1673-4826-801f-193783383cf2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:32.143812 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9cbc96ef-1673-4826-801f-193783383cf2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:32.147626 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9cbc96ef-1673-4826-801f-193783383cf2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:32.148685 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9cbc96ef-1673-4826-801f-193783383cf2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:32.152729 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9cbc96ef-1673-4826-801f-193783383cf2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:32.192155 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-9cbc96ef-1673-4826-801f-193783383cf2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070666 Dec 15 13:06:32.193299 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 223/497] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:06:32 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:06:32.392489 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-03fa0b0f-f83b-4de2-9001-abbff3271364 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1971717840", "imageRef": "67890983-693f-44ed-bdf3-22321abeab26", "flavorRef": "452", "networks": [{"uuid": "162c3d0f-e234-47fd-9154-3a362a7fadde"}]}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:06:32.449724 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.network.neutron [None req-03fa0b0f-f83b-4de2-9001-abbff3271364 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] validate_networks() for [('162c3d0f-e234-47fd-9154-3a362a7fadde', None, None, None, None, None)] {{(pid=116098) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:06:32.559629 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-859aa9fb-77fc-465d-a1c5-7344ad85f87e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:32.560805 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-859aa9fb-77fc-465d-a1c5-7344ad85f87e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:32.573295 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-859aa9fb-77fc-465d-a1c5-7344ad85f87e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:32.573741 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-859aa9fb-77fc-465d-a1c5-7344ad85f87e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:32.574554 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-859aa9fb-77fc-465d-a1c5-7344ad85f87e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:32.574986 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-859aa9fb-77fc-465d-a1c5-7344ad85f87e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:32.705146 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-859aa9fb-77fc-465d-a1c5-7344ad85f87e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:32.712759 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-859aa9fb-77fc-465d-a1c5-7344ad85f87e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1501 microversion: 2.1 time: 0.156785 Dec 15 13:06:32.713412 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 224/498] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:32 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1501 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:32.728888 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-b0071a53-fe15-446b-8904-108f270c27a0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:32.729605 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-b0071a53-fe15-446b-8904-108f270c27a0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:32.736738 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b0071a53-fe15-446b-8904-108f270c27a0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:32.737190 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b0071a53-fe15-446b-8904-108f270c27a0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:32.738327 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b0071a53-fe15-446b-8904-108f270c27a0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:32.738776 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b0071a53-fe15-446b-8904-108f270c27a0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:32.837141 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-03fa0b0f-f83b-4de2-9001-abbff3271364 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Flavor limits 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:06:32.837561 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-03fa0b0f-f83b-4de2-9001-abbff3271364 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Image limits 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:06:32.838032 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-03fa0b0f-f83b-4de2-9001-abbff3271364 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Flavor pref 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:06:32.838467 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-03fa0b0f-f83b-4de2-9001-abbff3271364 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Image pref 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:06:32.838917 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-03fa0b0f-f83b-4de2-9001-abbff3271364 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:06:32.847682 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-03fa0b0f-f83b-4de2-9001-abbff3271364 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:32.848133 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-03fa0b0f-f83b-4de2-9001-abbff3271364 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:32.848944 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-03fa0b0f-f83b-4de2-9001-abbff3271364 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:32.849379 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-03fa0b0f-f83b-4de2-9001-abbff3271364 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:32.867152 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-03fa0b0f-f83b-4de2-9001-abbff3271364 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Getting quotas for project 04e0b910ad794c7db450e6bb1c96cd01. Resources: {'instances', 'cores', 'ram'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:06:32.871373 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-03fa0b0f-f83b-4de2-9001-abbff3271364 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Getting quotas for user 1b47404ef24941829d657acb729f93da and project 04e0b910ad794c7db450e6bb1c96cd01. Resources: {'instances', 'cores', 'ram'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:06:32.882579 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-b0071a53-fe15-446b-8904-108f270c27a0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:32.883590 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-03fa0b0f-f83b-4de2-9001-abbff3271364 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Going to run 1 instances... {{(pid=116098) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:06:32.885931 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-03fa0b0f-f83b-4de2-9001-abbff3271364 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67890983-693f-44ed-bdf3-22321abeab26',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:06:32.890228 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-b0071a53-fe15-446b-8904-108f270c27a0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1514 microversion: 2.1 time: 0.165423 Dec 15 13:06:32.890860 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 225/499] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:32 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:32.901496 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-e0fdaee8-e728-4f34-868a-a32b4a73a504 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:32.902604 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-e0fdaee8-e728-4f34-868a-a32b4a73a504 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:32.910348 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e0fdaee8-e728-4f34-868a-a32b4a73a504 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:32.911703 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e0fdaee8-e728-4f34-868a-a32b4a73a504 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:32.912659 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e0fdaee8-e728-4f34-868a-a32b4a73a504 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:32.913221 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e0fdaee8-e728-4f34-868a-a32b4a73a504 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:32.934399 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-03fa0b0f-f83b-4de2-9001-abbff3271364 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546106 Dec 15 13:06:32.940776 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 275/500] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Dec 15 13:06:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:06:32.945533 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0cbd981f-2e9e-4b39-a67a-d89e1dbd588f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:32.946393 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0cbd981f-2e9e-4b39-a67a-d89e1dbd588f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:33.009509 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0cbd981f-2e9e-4b39-a67a-d89e1dbd588f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:33.025187 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-0cbd981f-2e9e-4b39-a67a-d89e1dbd588f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1218 microversion: 2.1 time: 0.083283 Dec 15 13:06:33.026502 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 276/501] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:32 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:33.047193 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-72e45d1f-5c5b-4c9e-81ee-06fbbc1170d3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:33.048128 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-72e45d1f-5c5b-4c9e-81ee-06fbbc1170d3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:33.055726 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-72e45d1f-5c5b-4c9e-81ee-06fbbc1170d3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:33.056465 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-72e45d1f-5c5b-4c9e-81ee-06fbbc1170d3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:33.057402 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-72e45d1f-5c5b-4c9e-81ee-06fbbc1170d3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:33.058006 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-72e45d1f-5c5b-4c9e-81ee-06fbbc1170d3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:33.124545 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-e0fdaee8-e728-4f34-868a-a32b4a73a504 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:33.134383 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-e0fdaee8-e728-4f34-868a-a32b4a73a504 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:33.136514 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-e0fdaee8-e728-4f34-868a-a32b4a73a504 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:33.137967 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-e0fdaee8-e728-4f34-868a-a32b4a73a504 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1720 microversion: 2.20 time: 0.241215 Dec 15 13:06:33.138892 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 226/502] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:32 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1720 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:06:33.156718 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-55c1b35b-2fb1-4555-becb-6cc5200b6b91 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:33.157323 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-55c1b35b-2fb1-4555-becb-6cc5200b6b91 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:33.169632 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-55c1b35b-2fb1-4555-becb-6cc5200b6b91 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:33.172869 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-55c1b35b-2fb1-4555-becb-6cc5200b6b91 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:33.173781 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-55c1b35b-2fb1-4555-becb-6cc5200b6b91 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:33.174331 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-55c1b35b-2fb1-4555-becb-6cc5200b6b91 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:33.295848 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-72e45d1f-5c5b-4c9e-81ee-06fbbc1170d3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:33.311561 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-72e45d1f-5c5b-4c9e-81ee-06fbbc1170d3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.268147 Dec 15 13:06:33.313507 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 277/503] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:33 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:33.464994 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-55c1b35b-2fb1-4555-becb-6cc5200b6b91 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:33.472812 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-55c1b35b-2fb1-4555-becb-6cc5200b6b91 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1313 microversion: 2.1 time: 0.332274 Dec 15 13:06:33.473475 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 227/504] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:33 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:34.042359 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-3eb09405-c0a0-4ace-9e82-16e5872af46e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:34.042971 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-3eb09405-c0a0-4ace-9e82-16e5872af46e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:34.049886 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3eb09405-c0a0-4ace-9e82-16e5872af46e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:34.050312 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3eb09405-c0a0-4ace-9e82-16e5872af46e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:34.051090 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3eb09405-c0a0-4ace-9e82-16e5872af46e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:34.051528 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3eb09405-c0a0-4ace-9e82-16e5872af46e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:34.112898 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-3eb09405-c0a0-4ace-9e82-16e5872af46e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:34.121035 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-3eb09405-c0a0-4ace-9e82-16e5872af46e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1222 microversion: 2.1 time: 0.082321 Dec 15 13:06:34.121605 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 278/505] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:34 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:34.158911 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-25c75ce9-f48f-4925-b301-2604c137002e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:34.159615 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-25c75ce9-f48f-4925-b301-2604c137002e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:34.168272 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-25c75ce9-f48f-4925-b301-2604c137002e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:34.168974 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-25c75ce9-f48f-4925-b301-2604c137002e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:34.169914 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-25c75ce9-f48f-4925-b301-2604c137002e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:34.170387 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-25c75ce9-f48f-4925-b301-2604c137002e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:34.308217 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-25c75ce9-f48f-4925-b301-2604c137002e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:34.317142 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-25c75ce9-f48f-4925-b301-2604c137002e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:34.319651 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-25c75ce9-f48f-4925-b301-2604c137002e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:34.321037 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-25c75ce9-f48f-4925-b301-2604c137002e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1720 microversion: 2.20 time: 0.166672 Dec 15 13:06:34.321688 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 228/506] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:34 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:06:34.330427 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1e53ac85-82e8-480e-a803-fe016f292e0c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:34.331111 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1e53ac85-82e8-480e-a803-fe016f292e0c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:34.337066 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1e53ac85-82e8-480e-a803-fe016f292e0c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:34.337507 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1e53ac85-82e8-480e-a803-fe016f292e0c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:34.338308 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1e53ac85-82e8-480e-a803-fe016f292e0c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:34.338742 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1e53ac85-82e8-480e-a803-fe016f292e0c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:34.476644 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1e53ac85-82e8-480e-a803-fe016f292e0c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:34.486085 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1e53ac85-82e8-480e-a803-fe016f292e0c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.159780 Dec 15 13:06:34.486679 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 279/507] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:34 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:34.489183 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-a97ca795-2461-432a-83ae-79400cf62e88 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:34.489796 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-a97ca795-2461-432a-83ae-79400cf62e88 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:34.495524 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a97ca795-2461-432a-83ae-79400cf62e88 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:34.495972 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a97ca795-2461-432a-83ae-79400cf62e88 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:34.496745 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a97ca795-2461-432a-83ae-79400cf62e88 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:34.497180 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a97ca795-2461-432a-83ae-79400cf62e88 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:34.632725 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-a97ca795-2461-432a-83ae-79400cf62e88 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:34.639862 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-a97ca795-2461-432a-83ae-79400cf62e88 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1313 microversion: 2.1 time: 0.154370 Dec 15 13:06:34.641001 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 229/508] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:34 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:35.137455 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ac2d8215-66fc-4fd8-b459-afc833415bd9 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:35.138078 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ac2d8215-66fc-4fd8-b459-afc833415bd9 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:35.145978 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ac2d8215-66fc-4fd8-b459-afc833415bd9 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:35.146456 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ac2d8215-66fc-4fd8-b459-afc833415bd9 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:35.147375 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ac2d8215-66fc-4fd8-b459-afc833415bd9 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:35.147840 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ac2d8215-66fc-4fd8-b459-afc833415bd9 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:35.221800 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ac2d8215-66fc-4fd8-b459-afc833415bd9 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:35.229460 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ac2d8215-66fc-4fd8-b459-afc833415bd9 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1214 microversion: 2.1 time: 0.095634 Dec 15 13:06:35.230025 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 280/509] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:35 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:35.341904 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-c3cf9b6a-1dc5-4881-85e8-4893954d8efc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:35.343943 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-c3cf9b6a-1dc5-4881-85e8-4893954d8efc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:35.356446 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c3cf9b6a-1dc5-4881-85e8-4893954d8efc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:35.356965 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c3cf9b6a-1dc5-4881-85e8-4893954d8efc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:35.357918 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c3cf9b6a-1dc5-4881-85e8-4893954d8efc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:35.358440 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c3cf9b6a-1dc5-4881-85e8-4893954d8efc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:35.504662 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a0f35e8d-6b7a-46f5-a8ce-9fa76e55562d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:35.505890 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a0f35e8d-6b7a-46f5-a8ce-9fa76e55562d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:35.527612 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a0f35e8d-6b7a-46f5-a8ce-9fa76e55562d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:35.528359 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a0f35e8d-6b7a-46f5-a8ce-9fa76e55562d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:35.532348 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a0f35e8d-6b7a-46f5-a8ce-9fa76e55562d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:35.532652 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-c3cf9b6a-1dc5-4881-85e8-4893954d8efc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:35.533019 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a0f35e8d-6b7a-46f5-a8ce-9fa76e55562d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:35.544294 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-c3cf9b6a-1dc5-4881-85e8-4893954d8efc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:35.546311 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-c3cf9b6a-1dc5-4881-85e8-4893954d8efc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:35.548684 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-c3cf9b6a-1dc5-4881-85e8-4893954d8efc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1720 microversion: 2.20 time: 0.211194 Dec 15 13:06:35.561894 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 230/510] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:35 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1720 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:06:35.657271 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-daedf08d-440c-42a4-b3b8-6513cfa765e9 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:35.658095 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-daedf08d-440c-42a4-b3b8-6513cfa765e9 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:35.663909 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-daedf08d-440c-42a4-b3b8-6513cfa765e9 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:35.664360 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-daedf08d-440c-42a4-b3b8-6513cfa765e9 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:35.665144 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-daedf08d-440c-42a4-b3b8-6513cfa765e9 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:35.665578 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-daedf08d-440c-42a4-b3b8-6513cfa765e9 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:35.776536 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a0f35e8d-6b7a-46f5-a8ce-9fa76e55562d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:35.786579 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a0f35e8d-6b7a-46f5-a8ce-9fa76e55562d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.285989 Dec 15 13:06:35.787726 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 281/511] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:35 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:35.813931 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-daedf08d-440c-42a4-b3b8-6513cfa765e9 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:35.822749 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-daedf08d-440c-42a4-b3b8-6513cfa765e9 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1313 microversion: 2.1 time: 0.169501 Dec 15 13:06:35.823337 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 231/512] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:35 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:35.872380 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-67408d29-b507-474b-b808-34fc181af590 req-dd2495c3-189a-45a4-a660-1dc5e6b20608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "902f62f8-3d70-4b3a-90a6-c924126e5300", "tag": "c3e32283-04ca-4ceb-90b7-6e2249b3c261"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:06:35.872961 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:06:35.872961 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:06:35.880399 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-67408d29-b507-474b-b808-34fc181af590 req-dd2495c3-189a-45a4-a660-1dc5e6b20608 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:35.880939 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-67408d29-b507-474b-b808-34fc181af590 req-dd2495c3-189a-45a4-a660-1dc5e6b20608 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:35.896353 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-67408d29-b507-474b-b808-34fc181af590 req-dd2495c3-189a-45a4-a660-1dc5e6b20608 service nova] Creating event network-changed:c3e32283-04ca-4ceb-90b7-6e2249b3c261 for instance 902f62f8-3d70-4b3a-90a6-c924126e5300 on hv-cinder-81322 Dec 15 13:06:35.900976 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-67408d29-b507-474b-b808-34fc181af590 req-dd2495c3-189a-45a4-a660-1dc5e6b20608 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033317 Dec 15 13:06:35.901561 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 282/513] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:06:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:06:36.254034 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-dcb4af77-afce-4786-9434-45544c4eb5ac tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:36.254805 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-dcb4af77-afce-4786-9434-45544c4eb5ac tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:36.263240 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dcb4af77-afce-4786-9434-45544c4eb5ac tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:36.263917 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dcb4af77-afce-4786-9434-45544c4eb5ac tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:36.264847 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dcb4af77-afce-4786-9434-45544c4eb5ac tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:36.267417 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dcb4af77-afce-4786-9434-45544c4eb5ac tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:36.340483 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-dcb4af77-afce-4786-9434-45544c4eb5ac tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:36.348890 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-dcb4af77-afce-4786-9434-45544c4eb5ac tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1276 microversion: 2.1 time: 0.099821 Dec 15 13:06:36.349805 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 232/514] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:36 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1276 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:36.567610 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0ca62c9e-e511-431c-a677-a2c7b785cda9 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:36.568242 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0ca62c9e-e511-431c-a677-a2c7b785cda9 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: 6d7e8b60-2efb-4376-ab88-65f915ebd89f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:36.570345 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-396c970e-61e0-4951-a5bf-f0b629bca029 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:36.570965 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-396c970e-61e0-4951-a5bf-f0b629bca029 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:36.579124 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0ca62c9e-e511-431c-a677-a2c7b785cda9 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:36.580822 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0ca62c9e-e511-431c-a677-a2c7b785cda9 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:36.581818 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-396c970e-61e0-4951-a5bf-f0b629bca029 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:36.582338 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-396c970e-61e0-4951-a5bf-f0b629bca029 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:36.583138 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0ca62c9e-e511-431c-a677-a2c7b785cda9 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:36.583258 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-396c970e-61e0-4951-a5bf-f0b629bca029 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:36.583591 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-396c970e-61e0-4951-a5bf-f0b629bca029 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:36.583722 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0ca62c9e-e511-431c-a677-a2c7b785cda9 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:36.627580 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0ca62c9e-e511-431c-a677-a2c7b785cda9 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: 6d7e8b60-2efb-4376-ab88-65f915ebd89f] Going to try to terminate instance {{(pid=116098) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:06:36.736743 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-0ca62c9e-e511-431c-a677-a2c7b785cda9 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f" status: 204 len: 0 microversion: 2.1 time: 0.172945 Dec 15 13:06:36.742504 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 283/515] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Dec 15 13:06:36 2021] DELETE /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:06:36.748948 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-553c830e-69f4-4978-8c1f-5aaed48a7b2f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:06:36.751264 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-553c830e-69f4-4978-8c1f-5aaed48a7b2f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:36.757183 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-553c830e-69f4-4978-8c1f-5aaed48a7b2f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:36.757633 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-553c830e-69f4-4978-8c1f-5aaed48a7b2f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:36.758465 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-553c830e-69f4-4978-8c1f-5aaed48a7b2f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:36.758903 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-553c830e-69f4-4978-8c1f-5aaed48a7b2f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:36.808337 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.objects.instance [None req-553c830e-69f4-4978-8c1f-5aaed48a7b2f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lazy-loading 'flavor' on Instance uuid 46358568-c4cc-4dd2-81e7-c724c57ee533 {{(pid=116098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:06:36.962897 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-553c830e-69f4-4978-8c1f-5aaed48a7b2f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "POST /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/action" status: 200 len: 32 microversion: 2.1 time: 0.216320 Dec 15 13:06:36.969110 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 284/516] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:06:36 2021] POST /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/action => generated 32 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:06:36.977156 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7f4ff70c-3e97-4250-8e8c-c4c0693b79fb tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "22f5dc69-e609-43f4-aa40-9ab6636aedf9"}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:06:36.979071 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7f4ff70c-3e97-4250-8e8c-c4c0693b79fb tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:36.988444 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7f4ff70c-3e97-4250-8e8c-c4c0693b79fb tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:36.989435 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7f4ff70c-3e97-4250-8e8c-c4c0693b79fb tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:36.991551 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7f4ff70c-3e97-4250-8e8c-c4c0693b79fb tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:36.992311 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7f4ff70c-3e97-4250-8e8c-c4c0693b79fb tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:37.221385 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-396c970e-61e0-4951-a5bf-f0b629bca029 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:37.243525 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-396c970e-61e0-4951-a5bf-f0b629bca029 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:37.247269 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-396c970e-61e0-4951-a5bf-f0b629bca029 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:37.251874 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-396c970e-61e0-4951-a5bf-f0b629bca029 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1720 microversion: 2.20 time: 0.685296 Dec 15 13:06:37.254897 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 233/517] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:36 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1720 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:06:37.282712 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-3c2c48a1-ac9c-46b4-aec0-820014f239d0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:37.283491 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-3c2c48a1-ac9c-46b4-aec0-820014f239d0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: 6d7e8b60-2efb-4376-ab88-65f915ebd89f] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:37.290810 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3c2c48a1-ac9c-46b4-aec0-820014f239d0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:37.292841 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3c2c48a1-ac9c-46b4-aec0-820014f239d0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:37.293905 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3c2c48a1-ac9c-46b4-aec0-820014f239d0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:37.294543 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3c2c48a1-ac9c-46b4-aec0-820014f239d0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:37.491002 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7f4ff70c-3e97-4250-8e8c-c4c0693b79fb tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "POST /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.518953 Dec 15 13:06:37.493900 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 285/518] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Dec 15 13:06:36 2021] POST /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e/os-volume_attachments => generated 194 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:06:37.517107 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7c0d2491-9a18-4b43-98f6-504d52a5d1ac tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:37.519880 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7c0d2491-9a18-4b43-98f6-504d52a5d1ac tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:37.527966 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7c0d2491-9a18-4b43-98f6-504d52a5d1ac tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:37.528455 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7c0d2491-9a18-4b43-98f6-504d52a5d1ac tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:37.529352 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7c0d2491-9a18-4b43-98f6-504d52a5d1ac tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:37.529834 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7c0d2491-9a18-4b43-98f6-504d52a5d1ac tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:37.694925 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-3c2c48a1-ac9c-46b4-aec0-820014f239d0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:37.713243 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-3c2c48a1-ac9c-46b4-aec0-820014f239d0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f" status: 200 len: 1511 microversion: 2.1 time: 0.455257 Dec 15 13:06:37.717774 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 234/519] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:37 2021] GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f => generated 1511 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:37.725434 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-1ae8211a-fe3d-4078-87e2-199fb27c67f3 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:37.726669 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-1ae8211a-fe3d-4078-87e2-199fb27c67f3 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:37.742339 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1ae8211a-fe3d-4078-87e2-199fb27c67f3 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:37.743524 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1ae8211a-fe3d-4078-87e2-199fb27c67f3 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:37.747090 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1ae8211a-fe3d-4078-87e2-199fb27c67f3 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:37.747623 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1ae8211a-fe3d-4078-87e2-199fb27c67f3 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:37.783993 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-7c0d2491-9a18-4b43-98f6-504d52a5d1ac tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:37.792644 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7c0d2491-9a18-4b43-98f6-504d52a5d1ac tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.297236 Dec 15 13:06:37.793219 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 286/520] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:37 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:37.797835 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9ae1abbb-4108-4f01-8bf6-886a26c0f4e4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:37.799046 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9ae1abbb-4108-4f01-8bf6-886a26c0f4e4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:37.809563 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9ae1abbb-4108-4f01-8bf6-886a26c0f4e4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:37.810186 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9ae1abbb-4108-4f01-8bf6-886a26c0f4e4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:37.811110 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9ae1abbb-4108-4f01-8bf6-886a26c0f4e4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:37.811614 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9ae1abbb-4108-4f01-8bf6-886a26c0f4e4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:37.954646 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-9ae1abbb-4108-4f01-8bf6-886a26c0f4e4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:37.962384 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9ae1abbb-4108-4f01-8bf6-886a26c0f4e4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.168146 Dec 15 13:06:37.962958 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 287/521] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:37 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:37.967458 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-70aca2ea-8753-4771-93d1-efd4f0854143 req-92b8160f-0c65-41b0-9ea3-ba7d30458b6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "703b5e88-39f0-436c-ac5a-f1701ec4d7c9", "name": "network-vif-unplugged", "status": "completed", "tag": "82fec70a-827b-4ef1-8922-a834a47147e1"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:06:37.969693 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:06:37.969693 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:06:37.976682 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-70aca2ea-8753-4771-93d1-efd4f0854143 req-92b8160f-0c65-41b0-9ea3-ba7d30458b6b service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:37.977123 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-70aca2ea-8753-4771-93d1-efd4f0854143 req-92b8160f-0c65-41b0-9ea3-ba7d30458b6b service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:37.988156 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-70aca2ea-8753-4771-93d1-efd4f0854143 req-92b8160f-0c65-41b0-9ea3-ba7d30458b6b service nova] Creating event network-vif-unplugged:82fec70a-827b-4ef1-8922-a834a47147e1 for instance 703b5e88-39f0-436c-ac5a-f1701ec4d7c9 on hv-cinder-81322 Dec 15 13:06:37.992939 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-70aca2ea-8753-4771-93d1-efd4f0854143 req-92b8160f-0c65-41b0-9ea3-ba7d30458b6b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028826 Dec 15 13:06:37.993474 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 288/522] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:06:37 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:06:37.998482 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-28e05ae2-51c5-4bbe-8198-7b8ab42fa2ee tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:37.999217 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-28e05ae2-51c5-4bbe-8198-7b8ab42fa2ee tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:38.005369 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-28e05ae2-51c5-4bbe-8198-7b8ab42fa2ee tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:38.005925 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-28e05ae2-51c5-4bbe-8198-7b8ab42fa2ee tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:38.006739 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-28e05ae2-51c5-4bbe-8198-7b8ab42fa2ee tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:38.007198 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-28e05ae2-51c5-4bbe-8198-7b8ab42fa2ee tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:38.138779 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-28e05ae2-51c5-4bbe-8198-7b8ab42fa2ee tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:38.146574 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-28e05ae2-51c5-4bbe-8198-7b8ab42fa2ee tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1318 microversion: 2.1 time: 0.151956 Dec 15 13:06:38.147152 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 289/523] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:37 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:38.151343 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-1ae8211a-fe3d-4078-87e2-199fb27c67f3 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:38.159012 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-1ae8211a-fe3d-4078-87e2-199fb27c67f3 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1313 microversion: 2.1 time: 0.439886 Dec 15 13:06:38.159608 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 235/524] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:37 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1313 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:38.274872 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ec86aef2-713f-4e9e-b7fc-913bd90997a5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:38.275483 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ec86aef2-713f-4e9e-b7fc-913bd90997a5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:38.282740 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ec86aef2-713f-4e9e-b7fc-913bd90997a5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:38.283375 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ec86aef2-713f-4e9e-b7fc-913bd90997a5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:38.283975 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ec86aef2-713f-4e9e-b7fc-913bd90997a5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:38.284412 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ec86aef2-713f-4e9e-b7fc-913bd90997a5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:38.469442 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ec86aef2-713f-4e9e-b7fc-913bd90997a5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:38.485977 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ec86aef2-713f-4e9e-b7fc-913bd90997a5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:38.488527 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ec86aef2-713f-4e9e-b7fc-913bd90997a5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:38.490812 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ec86aef2-713f-4e9e-b7fc-913bd90997a5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1720 microversion: 2.20 time: 0.223331 Dec 15 13:06:38.502385 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 290/525] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:38 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1720 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:06:38.708815 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-9cbeb9c2-be40-4f4e-b6fe-afcfcf766aa5 req-665bde03-f95f-44b8-afb6-a7b0986de0a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "538de0dc-a820-43f0-8b8f-0966f219e960", "tag": "37796afb-3b88-4e52-8372-230d4df65445"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:06:38.710462 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:06:38.710462 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:06:38.717617 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-9cbeb9c2-be40-4f4e-b6fe-afcfcf766aa5 req-665bde03-f95f-44b8-afb6-a7b0986de0a9 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:38.718063 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-9cbeb9c2-be40-4f4e-b6fe-afcfcf766aa5 req-665bde03-f95f-44b8-afb6-a7b0986de0a9 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:38.733001 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-9cbeb9c2-be40-4f4e-b6fe-afcfcf766aa5 req-665bde03-f95f-44b8-afb6-a7b0986de0a9 service nova] Creating event network-changed:37796afb-3b88-4e52-8372-230d4df65445 for instance 538de0dc-a820-43f0-8b8f-0966f219e960 on hv-cinder-81322 Dec 15 13:06:38.736274 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9c9600a8-e41d-4f96-989a-a842a1766c08 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:38.737897 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9c9600a8-e41d-4f96-989a-a842a1766c08 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: 6d7e8b60-2efb-4376-ab88-65f915ebd89f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:38.738995 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-9cbeb9c2-be40-4f4e-b6fe-afcfcf766aa5 req-665bde03-f95f-44b8-afb6-a7b0986de0a9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033817 Dec 15 13:06:38.739962 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 236/526] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:06:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:06:38.744811 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9c9600a8-e41d-4f96-989a-a842a1766c08 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:38.745295 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9c9600a8-e41d-4f96-989a-a842a1766c08 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:38.746182 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9c9600a8-e41d-4f96-989a-a842a1766c08 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:38.746635 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9c9600a8-e41d-4f96-989a-a842a1766c08 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:38.810637 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-3ed8ac1e-939c-40ad-9d49-72086b64579c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:38.811357 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-3ed8ac1e-939c-40ad-9d49-72086b64579c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:38.827639 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3ed8ac1e-939c-40ad-9d49-72086b64579c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:38.828102 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3ed8ac1e-939c-40ad-9d49-72086b64579c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:38.828925 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3ed8ac1e-939c-40ad-9d49-72086b64579c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:38.829377 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3ed8ac1e-939c-40ad-9d49-72086b64579c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:38.944716 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-9c9600a8-e41d-4f96-989a-a842a1766c08 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:38.954853 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9c9600a8-e41d-4f96-989a-a842a1766c08 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f" status: 200 len: 1511 microversion: 2.1 time: 0.223821 Dec 15 13:06:38.955816 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 291/527] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:38 2021] GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f => generated 1511 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:38.981575 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-96982c0f-3234-4949-b56d-4568705a96f3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:38.982308 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-96982c0f-3234-4949-b56d-4568705a96f3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:38.988608 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-96982c0f-3234-4949-b56d-4568705a96f3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:38.989126 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-96982c0f-3234-4949-b56d-4568705a96f3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:38.990044 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-96982c0f-3234-4949-b56d-4568705a96f3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:38.990712 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-96982c0f-3234-4949-b56d-4568705a96f3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:39.101676 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-3ed8ac1e-939c-40ad-9d49-72086b64579c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:39.113392 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-3ed8ac1e-939c-40ad-9d49-72086b64579c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.306722 Dec 15 13:06:39.123935 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 237/528] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:38 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:39.156207 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-96982c0f-3234-4949-b56d-4568705a96f3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:39.163134 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-38dc2bea-0aba-408d-a647-910c736c954e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:39.163915 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-38dc2bea-0aba-408d-a647-910c736c954e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:39.164049 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-96982c0f-3234-4949-b56d-4568705a96f3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.186678 Dec 15 13:06:39.164880 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 292/529] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:38 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:39.170805 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-38dc2bea-0aba-408d-a647-910c736c954e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:39.170805 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-38dc2bea-0aba-408d-a647-910c736c954e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:39.171262 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-38dc2bea-0aba-408d-a647-910c736c954e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:39.171916 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-38dc2bea-0aba-408d-a647-910c736c954e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:39.179135 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-45e0bb9a-f1df-4fff-9c92-899e8500b883 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:39.179776 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-45e0bb9a-f1df-4fff-9c92-899e8500b883 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:39.185899 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-45e0bb9a-f1df-4fff-9c92-899e8500b883 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:39.186422 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-45e0bb9a-f1df-4fff-9c92-899e8500b883 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:39.187772 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-45e0bb9a-f1df-4fff-9c92-899e8500b883 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:39.188251 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-45e0bb9a-f1df-4fff-9c92-899e8500b883 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:39.332725 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-45e0bb9a-f1df-4fff-9c92-899e8500b883 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:39.341371 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-45e0bb9a-f1df-4fff-9c92-899e8500b883 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1313 microversion: 2.1 time: 0.165867 Dec 15 13:06:39.341969 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 293/530] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:39 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:39.342750 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-38dc2bea-0aba-408d-a647-910c736c954e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:39.350946 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-38dc2bea-0aba-408d-a647-910c736c954e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1318 microversion: 2.1 time: 0.191323 Dec 15 13:06:39.351592 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 238/531] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:39 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:39.508507 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-be3d37a3-4dc2-4bb5-8700-a5de4083cb24 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:39.509115 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-be3d37a3-4dc2-4bb5-8700-a5de4083cb24 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:39.515360 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be3d37a3-4dc2-4bb5-8700-a5de4083cb24 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:39.515835 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be3d37a3-4dc2-4bb5-8700-a5de4083cb24 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:39.516678 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be3d37a3-4dc2-4bb5-8700-a5de4083cb24 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:39.517135 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be3d37a3-4dc2-4bb5-8700-a5de4083cb24 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:39.669627 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-be3d37a3-4dc2-4bb5-8700-a5de4083cb24 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:39.679264 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-be3d37a3-4dc2-4bb5-8700-a5de4083cb24 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:39.682043 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-be3d37a3-4dc2-4bb5-8700-a5de4083cb24 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:39.683402 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-be3d37a3-4dc2-4bb5-8700-a5de4083cb24 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1723 microversion: 2.20 time: 0.178560 Dec 15 13:06:39.703581 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-067791b1-f400-417a-bbd5-9d2787d80ea8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04ae4504-fb56-430a-a43f-e2b354e7822b"}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:06:39.705250 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-067791b1-f400-417a-bbd5-9d2787d80ea8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:39.709535 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 294/532] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:39 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:06:39.716397 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-067791b1-f400-417a-bbd5-9d2787d80ea8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:39.716990 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-067791b1-f400-417a-bbd5-9d2787d80ea8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:39.720716 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-067791b1-f400-417a-bbd5-9d2787d80ea8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:39.721508 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-067791b1-f400-417a-bbd5-9d2787d80ea8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:39.972478 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4f800879-eb2f-4052-9811-e8de926ebcc1 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:39.973603 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4f800879-eb2f-4052-9811-e8de926ebcc1 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: 6d7e8b60-2efb-4376-ab88-65f915ebd89f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:39.980748 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4f800879-eb2f-4052-9811-e8de926ebcc1 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:39.981187 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4f800879-eb2f-4052-9811-e8de926ebcc1 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:39.981966 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4f800879-eb2f-4052-9811-e8de926ebcc1 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:39.982463 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4f800879-eb2f-4052-9811-e8de926ebcc1 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:40.033055 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-067791b1-f400-417a-bbd5-9d2787d80ea8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.334087 Dec 15 13:06:40.034266 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 239/533] 10.222.0.57 () {62 vars in 1363 bytes} [Wed Dec 15 13:06:39 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments => generated 188 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:06:40.127137 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4f800879-eb2f-4052-9811-e8de926ebcc1 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:40.131938 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-bee0cd8f-dfb2-4ccc-bfee-26be05e645e9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:40.132562 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-bee0cd8f-dfb2-4ccc-bfee-26be05e645e9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:40.135948 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4f800879-eb2f-4052-9811-e8de926ebcc1 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f" status: 200 len: 1511 microversion: 2.1 time: 0.167556 Dec 15 13:06:40.137148 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 295/534] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:39 2021] GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f => generated 1511 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:40.138935 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-bee0cd8f-dfb2-4ccc-bfee-26be05e645e9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:40.139384 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-bee0cd8f-dfb2-4ccc-bfee-26be05e645e9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:40.140925 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-bee0cd8f-dfb2-4ccc-bfee-26be05e645e9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:40.141351 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-bee0cd8f-dfb2-4ccc-bfee-26be05e645e9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:40.152350 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-2c18b65d-ae46-4f48-b230-fd63dfc3fec4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:06:40.152965 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-2c18b65d-ae46-4f48-b230-fd63dfc3fec4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:40.159048 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2c18b65d-ae46-4f48-b230-fd63dfc3fec4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:40.159493 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2c18b65d-ae46-4f48-b230-fd63dfc3fec4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:40.160272 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2c18b65d-ae46-4f48-b230-fd63dfc3fec4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:40.160700 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2c18b65d-ae46-4f48-b230-fd63dfc3fec4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:40.263790 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-2c18b65d-ae46-4f48-b230-fd63dfc3fec4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action" status: 202 len: 0 microversion: 2.20 time: 0.115324 Dec 15 13:06:40.264633 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 296/535] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:06:40 2021] POST /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Dec 15 13:06:40.269135 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6c027bd1-8309-4b1e-8da6-af183390f92c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:40.269741 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-6c027bd1-8309-4b1e-8da6-af183390f92c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:40.276534 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6c027bd1-8309-4b1e-8da6-af183390f92c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:40.276982 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6c027bd1-8309-4b1e-8da6-af183390f92c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:40.277874 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6c027bd1-8309-4b1e-8da6-af183390f92c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:40.278307 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6c027bd1-8309-4b1e-8da6-af183390f92c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:40.339877 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-bee0cd8f-dfb2-4ccc-bfee-26be05e645e9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:40.347906 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-bee0cd8f-dfb2-4ccc-bfee-26be05e645e9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.220030 Dec 15 13:06:40.349057 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 240/536] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:40 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:40.354847 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-cd91078d-0e48-4e9e-9b72-33e8ff1258d6 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:40.355694 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-cd91078d-0e48-4e9e-9b72-33e8ff1258d6 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:40.363921 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cd91078d-0e48-4e9e-9b72-33e8ff1258d6 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:40.364850 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cd91078d-0e48-4e9e-9b72-33e8ff1258d6 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:40.366039 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cd91078d-0e48-4e9e-9b72-33e8ff1258d6 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:40.366695 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cd91078d-0e48-4e9e-9b72-33e8ff1258d6 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:40.435046 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-6c027bd1-8309-4b1e-8da6-af183390f92c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:40.444849 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6c027bd1-8309-4b1e-8da6-af183390f92c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.179278 Dec 15 13:06:40.445697 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 297/537] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:40 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:40.458924 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0b7f0039-4667-470e-8e69-283e06c19d5e tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:40.459523 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0b7f0039-4667-470e-8e69-283e06c19d5e tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:40.465303 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0b7f0039-4667-470e-8e69-283e06c19d5e tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:40.465737 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0b7f0039-4667-470e-8e69-283e06c19d5e tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:40.467013 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0b7f0039-4667-470e-8e69-283e06c19d5e tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:40.467013 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0b7f0039-4667-470e-8e69-283e06c19d5e tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:40.604252 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0b7f0039-4667-470e-8e69-283e06c19d5e tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:40.613568 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-0b7f0039-4667-470e-8e69-283e06c19d5e tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1313 microversion: 2.1 time: 0.158056 Dec 15 13:06:40.623716 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 298/538] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:40 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:40.623803 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-cd91078d-0e48-4e9e-9b72-33e8ff1258d6 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:40.623894 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-523d57ef-1c42-4e8e-a901-502c3e001f89 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:40.623894 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-523d57ef-1c42-4e8e-a901-502c3e001f89 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:40.630174 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-523d57ef-1c42-4e8e-a901-502c3e001f89 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:40.630655 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-523d57ef-1c42-4e8e-a901-502c3e001f89 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:40.631265 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-cd91078d-0e48-4e9e-9b72-33e8ff1258d6 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:40.631688 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-523d57ef-1c42-4e8e-a901-502c3e001f89 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:40.632372 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-523d57ef-1c42-4e8e-a901-502c3e001f89 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:40.632765 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-cd91078d-0e48-4e9e-9b72-33e8ff1258d6 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:40.633921 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-cd91078d-0e48-4e9e-9b72-33e8ff1258d6 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1749 microversion: 2.20 time: 0.283550 Dec 15 13:06:40.634822 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 241/539] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:40 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1749 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:06:40.808526 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-523d57ef-1c42-4e8e-a901-502c3e001f89 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:40.817369 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-523d57ef-1c42-4e8e-a901-502c3e001f89 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1318 microversion: 2.1 time: 0.202079 Dec 15 13:06:40.818169 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 299/540] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:40 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:40.957514 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-98f451be-1d93-43d3-95e0-6f9292a1ba22 req-8dbd7b9c-33fb-4dc7-907e-e9fc5c71d745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d7e8b60-2efb-4376-ab88-65f915ebd89f", "name": "network-vif-deleted", "tag": "3f816332-ae3d-4fab-880e-1af562f3a33e"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:06:40.959445 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:06:40.959445 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:06:40.967481 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-98f451be-1d93-43d3-95e0-6f9292a1ba22 req-8dbd7b9c-33fb-4dc7-907e-e9fc5c71d745 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:40.969323 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-98f451be-1d93-43d3-95e0-6f9292a1ba22 req-8dbd7b9c-33fb-4dc7-907e-e9fc5c71d745 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:40.981373 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-98f451be-1d93-43d3-95e0-6f9292a1ba22 req-8dbd7b9c-33fb-4dc7-907e-e9fc5c71d745 service nova] Creating event network-vif-deleted:3f816332-ae3d-4fab-880e-1af562f3a33e for instance 6d7e8b60-2efb-4376-ab88-65f915ebd89f on hv-cinder-81322 Dec 15 13:06:40.987488 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-98f451be-1d93-43d3-95e0-6f9292a1ba22 req-8dbd7b9c-33fb-4dc7-907e-e9fc5c71d745 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033532 Dec 15 13:06:40.991525 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 242/541] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:06:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:06:41.155025 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b747a2da-9e04-451e-9e59-b993603e1c32 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:41.155838 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b747a2da-9e04-451e-9e59-b993603e1c32 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: 6d7e8b60-2efb-4376-ab88-65f915ebd89f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:41.163963 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b747a2da-9e04-451e-9e59-b993603e1c32 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:41.164435 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b747a2da-9e04-451e-9e59-b993603e1c32 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:41.166905 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b747a2da-9e04-451e-9e59-b993603e1c32 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:41.167258 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b747a2da-9e04-451e-9e59-b993603e1c32 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:41.209243 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b747a2da-9e04-451e-9e59-b993603e1c32 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:41.209859 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b747a2da-9e04-451e-9e59-b993603e1c32 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:41.210473 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.objects.instance [None req-b747a2da-9e04-451e-9e59-b993603e1c32 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lazy-loading 'fault' on Instance uuid 6d7e8b60-2efb-4376-ab88-65f915ebd89f {{(pid=116098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:06:41.267440 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b747a2da-9e04-451e-9e59-b993603e1c32 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:41.277969 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b747a2da-9e04-451e-9e59-b993603e1c32 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f" status: 200 len: 1307 microversion: 2.1 time: 0.126347 Dec 15 13:06:41.279090 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 300/542] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:41 2021] GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f => generated 1307 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:41.366627 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-2d495804-fe80-43e8-9d13-ef7b90a29d47 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:41.367498 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-2d495804-fe80-43e8-9d13-ef7b90a29d47 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:41.376748 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2d495804-fe80-43e8-9d13-ef7b90a29d47 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:41.379024 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2d495804-fe80-43e8-9d13-ef7b90a29d47 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:41.380646 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2d495804-fe80-43e8-9d13-ef7b90a29d47 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:41.381725 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2d495804-fe80-43e8-9d13-ef7b90a29d47 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:41.460781 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ed59ccb5-b898-4a06-9595-11d27700cb3d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:41.461520 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ed59ccb5-b898-4a06-9595-11d27700cb3d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:41.469171 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ed59ccb5-b898-4a06-9595-11d27700cb3d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:41.469944 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ed59ccb5-b898-4a06-9595-11d27700cb3d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:41.471104 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ed59ccb5-b898-4a06-9595-11d27700cb3d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:41.471515 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ed59ccb5-b898-4a06-9595-11d27700cb3d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:41.575464 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-2d495804-fe80-43e8-9d13-ef7b90a29d47 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:41.593062 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-2d495804-fe80-43e8-9d13-ef7b90a29d47 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1723 microversion: 2.1 time: 0.230705 Dec 15 13:06:41.594191 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 243/543] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:41 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:41.651622 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-3a3d0d4f-76ef-4e4e-b6e0-5f0650eea104 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:41.652227 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-3a3d0d4f-76ef-4e4e-b6e0-5f0650eea104 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:41.658585 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3a3d0d4f-76ef-4e4e-b6e0-5f0650eea104 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:41.659053 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3a3d0d4f-76ef-4e4e-b6e0-5f0650eea104 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:41.659980 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3a3d0d4f-76ef-4e4e-b6e0-5f0650eea104 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:41.660425 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3a3d0d4f-76ef-4e4e-b6e0-5f0650eea104 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:41.729259 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ed59ccb5-b898-4a06-9595-11d27700cb3d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:41.744152 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ed59ccb5-b898-4a06-9595-11d27700cb3d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.286691 Dec 15 13:06:41.745406 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 301/544] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:41 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:41.753578 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-be05e890-8c33-4a31-b1b8-a6a6d4ae94d0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:41.754749 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-be05e890-8c33-4a31-b1b8-a6a6d4ae94d0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:41.762302 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be05e890-8c33-4a31-b1b8-a6a6d4ae94d0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:41.762819 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be05e890-8c33-4a31-b1b8-a6a6d4ae94d0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:41.763594 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be05e890-8c33-4a31-b1b8-a6a6d4ae94d0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:41.764017 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be05e890-8c33-4a31-b1b8-a6a6d4ae94d0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:41.874218 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-3a3d0d4f-76ef-4e4e-b6e0-5f0650eea104 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:41.882483 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-3a3d0d4f-76ef-4e4e-b6e0-5f0650eea104 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1313 microversion: 2.1 time: 0.240830 Dec 15 13:06:41.884566 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 244/545] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:41 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:41.889352 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-f49c4b7c-6ae2-40f4-8615-ab3627748233 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:41.893312 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-f49c4b7c-6ae2-40f4-8615-ab3627748233 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:41.908946 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f49c4b7c-6ae2-40f4-8615-ab3627748233 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:41.909474 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f49c4b7c-6ae2-40f4-8615-ab3627748233 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:41.910411 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f49c4b7c-6ae2-40f4-8615-ab3627748233 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:41.910958 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f49c4b7c-6ae2-40f4-8615-ab3627748233 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:41.977734 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-be05e890-8c33-4a31-b1b8-a6a6d4ae94d0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:41.987815 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-be05e890-8c33-4a31-b1b8-a6a6d4ae94d0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:41.990804 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-be05e890-8c33-4a31-b1b8-a6a6d4ae94d0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:41.992448 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-be05e890-8c33-4a31-b1b8-a6a6d4ae94d0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1751 microversion: 2.20 time: 0.245437 Dec 15 13:06:42.002748 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 302/546] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:41 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1751 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:06:42.086598 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-f49c4b7c-6ae2-40f4-8615-ab3627748233 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:42.094274 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-f49c4b7c-6ae2-40f4-8615-ab3627748233 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1318 microversion: 2.1 time: 0.208431 Dec 15 13:06:42.094828 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 245/547] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:41 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:42.303677 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-93b29ca6-a8fc-4d5b-9e82-e7d71462c9ef tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:42.304513 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-93b29ca6-a8fc-4d5b-9e82-e7d71462c9ef tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: 6d7e8b60-2efb-4376-ab88-65f915ebd89f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:42.313082 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-93b29ca6-a8fc-4d5b-9e82-e7d71462c9ef tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:42.313565 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-93b29ca6-a8fc-4d5b-9e82-e7d71462c9ef tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:42.314491 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-93b29ca6-a8fc-4d5b-9e82-e7d71462c9ef tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:42.314950 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-93b29ca6-a8fc-4d5b-9e82-e7d71462c9ef tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:42.329104 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-93b29ca6-a8fc-4d5b-9e82-e7d71462c9ef tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] HTTP exception thrown: Instance 6d7e8b60-2efb-4376-ab88-65f915ebd89f could not be found. Dec 15 13:06:42.329690 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-93b29ca6-a8fc-4d5b-9e82-e7d71462c9ef tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Returning 404 to user: Instance 6d7e8b60-2efb-4376-ab88-65f915ebd89f could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:06:42.330559 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-93b29ca6-a8fc-4d5b-9e82-e7d71462c9ef tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f" status: 404 len: 111 microversion: 2.1 time: 0.030577 Dec 15 13:06:42.331136 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 303/548] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:42 2021] GET /compute/v2.1/servers/6d7e8b60-2efb-4376-ab88-65f915ebd89f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 13:06:42.611084 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-f12a2904-578a-4b6f-a843-1d5a09cfb130 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:42.611598 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-f12a2904-578a-4b6f-a843-1d5a09cfb130 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:42.617494 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f12a2904-578a-4b6f-a843-1d5a09cfb130 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:42.618005 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f12a2904-578a-4b6f-a843-1d5a09cfb130 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:42.618740 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f12a2904-578a-4b6f-a843-1d5a09cfb130 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:42.619175 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f12a2904-578a-4b6f-a843-1d5a09cfb130 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:42.750870 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-f12a2904-578a-4b6f-a843-1d5a09cfb130 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:42.758568 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-f12a2904-578a-4b6f-a843-1d5a09cfb130 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1700 microversion: 2.1 time: 0.151136 Dec 15 13:06:42.759130 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 246/549] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:42 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1700 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:42.761886 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9a39223e-5586-4cb9-b807-c6201ab4108f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:42.762521 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9a39223e-5586-4cb9-b807-c6201ab4108f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:42.769644 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9a39223e-5586-4cb9-b807-c6201ab4108f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:42.770521 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9a39223e-5586-4cb9-b807-c6201ab4108f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:42.771495 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9a39223e-5586-4cb9-b807-c6201ab4108f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:42.772061 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9a39223e-5586-4cb9-b807-c6201ab4108f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:42.775490 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-bdd608a6-21f2-42c2-bfdd-ff0d866542d1 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:06:42.785057 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-bdd608a6-21f2-42c2-bfdd-ff0d866542d1 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:42.785611 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-bdd608a6-21f2-42c2-bfdd-ff0d866542d1 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:42.867907 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-bdd608a6-21f2-42c2-bfdd-ff0d866542d1 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Going to try to start instance {{(pid=116097) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 15 13:06:42.923851 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-bdd608a6-21f2-42c2-bfdd-ff0d866542d1 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 202 len: 0 microversion: 2.1 time: 0.151807 Dec 15 13:06:42.928571 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 247/550] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:06:42 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:06:42.938319 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-de20237b-326b-4384-9f4e-9428b2a945e6 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:42.940036 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-de20237b-326b-4384-9f4e-9428b2a945e6 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:42.954546 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-de20237b-326b-4384-9f4e-9428b2a945e6 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:42.955381 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-de20237b-326b-4384-9f4e-9428b2a945e6 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:42.956793 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-de20237b-326b-4384-9f4e-9428b2a945e6 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:42.957555 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-de20237b-326b-4384-9f4e-9428b2a945e6 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:42.988257 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-9a39223e-5586-4cb9-b807-c6201ab4108f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:43.014478 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9a39223e-5586-4cb9-b807-c6201ab4108f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.255848 Dec 15 13:06:43.016166 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 304/551] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:42 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:43.024305 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-11ef0a49-7942-486d-8550-a9881a21f989 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:43.025771 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-11ef0a49-7942-486d-8550-a9881a21f989 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:43.037648 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-11ef0a49-7942-486d-8550-a9881a21f989 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:43.038618 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-11ef0a49-7942-486d-8550-a9881a21f989 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:43.040147 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-11ef0a49-7942-486d-8550-a9881a21f989 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:43.040942 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-11ef0a49-7942-486d-8550-a9881a21f989 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:43.159896 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-de20237b-326b-4384-9f4e-9428b2a945e6 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:43.173266 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-de20237b-326b-4384-9f4e-9428b2a945e6 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1313 microversion: 2.1 time: 0.242326 Dec 15 13:06:43.190434 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 248/552] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:42 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:43.198540 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-238ac214-3d4c-4748-acc6-50fde1291326 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:43.199188 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-11ef0a49-7942-486d-8550-a9881a21f989 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:43.199346 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-238ac214-3d4c-4748-acc6-50fde1291326 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:43.205770 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-238ac214-3d4c-4748-acc6-50fde1291326 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:43.206252 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-238ac214-3d4c-4748-acc6-50fde1291326 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:43.207041 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-238ac214-3d4c-4748-acc6-50fde1291326 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:43.207476 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-238ac214-3d4c-4748-acc6-50fde1291326 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:43.207574 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-11ef0a49-7942-486d-8550-a9881a21f989 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1709 microversion: 2.1 time: 0.189665 Dec 15 13:06:43.208264 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 305/553] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:43 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1709 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:43.218120 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-66411f19-404f-4265-b8d8-f389782202f1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:43.218887 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-66411f19-404f-4265-b8d8-f389782202f1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:43.224846 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-66411f19-404f-4265-b8d8-f389782202f1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:43.225370 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-66411f19-404f-4265-b8d8-f389782202f1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:43.226315 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-66411f19-404f-4265-b8d8-f389782202f1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:43.226944 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-66411f19-404f-4265-b8d8-f389782202f1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:43.348002 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-238ac214-3d4c-4748-acc6-50fde1291326 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:43.356199 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-238ac214-3d4c-4748-acc6-50fde1291326 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:43.357690 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-238ac214-3d4c-4748-acc6-50fde1291326 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:43.359385 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-238ac214-3d4c-4748-acc6-50fde1291326 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1751 microversion: 2.20 time: 0.167581 Dec 15 13:06:43.359946 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 249/554] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:43 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:06:43.369647 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-66411f19-404f-4265-b8d8-f389782202f1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:43.380332 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-66411f19-404f-4265-b8d8-f389782202f1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1318 microversion: 2.1 time: 0.169148 Dec 15 13:06:43.380891 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 306/555] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:43 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:44.040430 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-3a4b9fee-eea5-4dcb-af5f-8fe4834037f8 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:44.041461 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-3a4b9fee-eea5-4dcb-af5f-8fe4834037f8 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:44.049059 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3a4b9fee-eea5-4dcb-af5f-8fe4834037f8 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:44.049801 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3a4b9fee-eea5-4dcb-af5f-8fe4834037f8 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:44.050817 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3a4b9fee-eea5-4dcb-af5f-8fe4834037f8 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:44.051422 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3a4b9fee-eea5-4dcb-af5f-8fe4834037f8 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:44.191365 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-3a4b9fee-eea5-4dcb-af5f-8fe4834037f8 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:44.198613 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-3a4b9fee-eea5-4dcb-af5f-8fe4834037f8 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.161753 Dec 15 13:06:44.199167 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 250/556] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:44 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:44.203783 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-dcc6a777-7362-458a-8ce3-a42884a8ac86 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:44.204389 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-dcc6a777-7362-458a-8ce3-a42884a8ac86 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:44.211220 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dcc6a777-7362-458a-8ce3-a42884a8ac86 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:44.211674 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dcc6a777-7362-458a-8ce3-a42884a8ac86 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:44.212443 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dcc6a777-7362-458a-8ce3-a42884a8ac86 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:44.212879 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dcc6a777-7362-458a-8ce3-a42884a8ac86 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:44.224660 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-51e9cbce-026f-4e10-b13c-45c0476fb7b3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:44.225368 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-51e9cbce-026f-4e10-b13c-45c0476fb7b3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:44.231814 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-51e9cbce-026f-4e10-b13c-45c0476fb7b3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:44.232483 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-51e9cbce-026f-4e10-b13c-45c0476fb7b3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:44.233480 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-51e9cbce-026f-4e10-b13c-45c0476fb7b3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:44.234270 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-51e9cbce-026f-4e10-b13c-45c0476fb7b3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:44.387484 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-51e9cbce-026f-4e10-b13c-45c0476fb7b3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:44.397430 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-51e9cbce-026f-4e10-b13c-45c0476fb7b3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1709 microversion: 2.1 time: 0.176328 Dec 15 13:06:44.398005 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 251/557] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:44 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1709 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:44.402012 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-dcc6a777-7362-458a-8ce3-a42884a8ac86 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:44.403154 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-dbc98345-03f5-4d21-a709-806934433845 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:44.403889 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-dbc98345-03f5-4d21-a709-806934433845 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:44.409618 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dbc98345-03f5-4d21-a709-806934433845 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:44.409818 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-dcc6a777-7362-458a-8ce3-a42884a8ac86 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1313 microversion: 2.1 time: 0.210397 Dec 15 13:06:44.410102 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dbc98345-03f5-4d21-a709-806934433845 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:44.410597 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 307/558] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:44 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:44.410938 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dbc98345-03f5-4d21-a709-806934433845 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:44.411809 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dbc98345-03f5-4d21-a709-806934433845 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:44.415456 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-622081db-e3c2-4c27-a517-436a0c7be496 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:44.416462 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-622081db-e3c2-4c27-a517-436a0c7be496 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:44.422700 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-622081db-e3c2-4c27-a517-436a0c7be496 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:44.423143 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-622081db-e3c2-4c27-a517-436a0c7be496 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:44.423917 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-622081db-e3c2-4c27-a517-436a0c7be496 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:44.424350 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-622081db-e3c2-4c27-a517-436a0c7be496 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:44.569846 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-dbc98345-03f5-4d21-a709-806934433845 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:44.585053 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-622081db-e3c2-4c27-a517-436a0c7be496 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:44.585870 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-dbc98345-03f5-4d21-a709-806934433845 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:44.587615 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-dbc98345-03f5-4d21-a709-806934433845 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:44.589081 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-dbc98345-03f5-4d21-a709-806934433845 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1751 microversion: 2.20 time: 0.190090 Dec 15 13:06:44.589731 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 252/559] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:44 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1751 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:06:44.597768 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-622081db-e3c2-4c27-a517-436a0c7be496 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1318 microversion: 2.1 time: 0.185386 Dec 15 13:06:44.598497 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 308/560] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:44 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:45.215649 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-e99c7b27-6a89-40b5-8469-2ede7c2c6fcd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:45.216258 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-e99c7b27-6a89-40b5-8469-2ede7c2c6fcd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:45.222917 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e99c7b27-6a89-40b5-8469-2ede7c2c6fcd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:45.223368 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e99c7b27-6a89-40b5-8469-2ede7c2c6fcd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:45.224141 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e99c7b27-6a89-40b5-8469-2ede7c2c6fcd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:45.224578 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e99c7b27-6a89-40b5-8469-2ede7c2c6fcd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:45.361357 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-e99c7b27-6a89-40b5-8469-2ede7c2c6fcd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:45.368643 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-e99c7b27-6a89-40b5-8469-2ede7c2c6fcd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.156603 Dec 15 13:06:45.369209 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 253/561] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:45 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:45.414693 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9d508129-3b62-4782-9448-091e5c7efb88 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:45.415373 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9d508129-3b62-4782-9448-091e5c7efb88 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:45.422706 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9d508129-3b62-4782-9448-091e5c7efb88 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:45.424412 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9d508129-3b62-4782-9448-091e5c7efb88 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:45.424412 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9d508129-3b62-4782-9448-091e5c7efb88 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:45.424412 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9d508129-3b62-4782-9448-091e5c7efb88 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:45.430649 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-76e6818b-6a69-4a81-bffb-cf0c15a14738 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:45.431694 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-76e6818b-6a69-4a81-bffb-cf0c15a14738 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:45.439688 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-76e6818b-6a69-4a81-bffb-cf0c15a14738 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:45.440591 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-76e6818b-6a69-4a81-bffb-cf0c15a14738 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:45.442507 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-76e6818b-6a69-4a81-bffb-cf0c15a14738 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:45.442779 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-76e6818b-6a69-4a81-bffb-cf0c15a14738 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:45.577584 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-9d508129-3b62-4782-9448-091e5c7efb88 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:45.586443 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9d508129-3b62-4782-9448-091e5c7efb88 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1709 microversion: 2.1 time: 0.175377 Dec 15 13:06:45.590501 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 309/562] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:45 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1709 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:45.604130 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-76e6818b-6a69-4a81-bffb-cf0c15a14738 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:45.613109 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-95913ed4-dcbd-4f2e-9ae6-88344e89c9eb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:45.613360 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-76e6818b-6a69-4a81-bffb-cf0c15a14738 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1313 microversion: 2.1 time: 0.187284 Dec 15 13:06:45.613714 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-95913ed4-dcbd-4f2e-9ae6-88344e89c9eb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:45.614079 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 254/563] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:45 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:45.622350 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-41b1fad1-6dbe-4766-8633-dd0465720b0b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:45.622638 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-95913ed4-dcbd-4f2e-9ae6-88344e89c9eb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:45.623198 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-95913ed4-dcbd-4f2e-9ae6-88344e89c9eb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:45.623490 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-41b1fad1-6dbe-4766-8633-dd0465720b0b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:45.631198 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-95913ed4-dcbd-4f2e-9ae6-88344e89c9eb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:45.631762 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-95913ed4-dcbd-4f2e-9ae6-88344e89c9eb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:45.638340 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-41b1fad1-6dbe-4766-8633-dd0465720b0b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:45.639013 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-41b1fad1-6dbe-4766-8633-dd0465720b0b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:45.640265 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-41b1fad1-6dbe-4766-8633-dd0465720b0b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:45.640926 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-41b1fad1-6dbe-4766-8633-dd0465720b0b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:45.786772 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-95913ed4-dcbd-4f2e-9ae6-88344e89c9eb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:45.799837 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-95913ed4-dcbd-4f2e-9ae6-88344e89c9eb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:45.801758 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-95913ed4-dcbd-4f2e-9ae6-88344e89c9eb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:45.804068 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-95913ed4-dcbd-4f2e-9ae6-88344e89c9eb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1751 microversion: 2.20 time: 0.196083 Dec 15 13:06:45.804068 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 310/564] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:45 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1751 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:06:45.812939 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-41b1fad1-6dbe-4766-8633-dd0465720b0b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:45.825398 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-41b1fad1-6dbe-4766-8633-dd0465720b0b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1318 microversion: 2.1 time: 0.209902 Dec 15 13:06:45.826025 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 255/565] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:45 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:46.386047 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-22086dee-4e30-47b0-81bb-969ab564b4c6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:46.387532 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-22086dee-4e30-47b0-81bb-969ab564b4c6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:46.393573 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-22086dee-4e30-47b0-81bb-969ab564b4c6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:46.394020 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-22086dee-4e30-47b0-81bb-969ab564b4c6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:46.394829 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-22086dee-4e30-47b0-81bb-969ab564b4c6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:46.395259 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-22086dee-4e30-47b0-81bb-969ab564b4c6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:46.534258 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-22086dee-4e30-47b0-81bb-969ab564b4c6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:46.541956 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-22086dee-4e30-47b0-81bb-969ab564b4c6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.159509 Dec 15 13:06:46.542561 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 311/566] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:46 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:46.627740 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-e12616db-38d9-4921-bd1d-01249dc4ce51 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:46.629028 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-e12616db-38d9-4921-bd1d-01249dc4ce51 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:46.644233 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d8daf3c4-f11f-4cf7-bf3d-0570cef4b28c tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:46.647751 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d8daf3c4-f11f-4cf7-bf3d-0570cef4b28c tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:46.664838 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e12616db-38d9-4921-bd1d-01249dc4ce51 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:46.666919 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e12616db-38d9-4921-bd1d-01249dc4ce51 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:46.670811 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d8daf3c4-f11f-4cf7-bf3d-0570cef4b28c tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:46.675011 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e12616db-38d9-4921-bd1d-01249dc4ce51 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:46.675214 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d8daf3c4-f11f-4cf7-bf3d-0570cef4b28c tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:46.676533 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d8daf3c4-f11f-4cf7-bf3d-0570cef4b28c tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:46.676890 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e12616db-38d9-4921-bd1d-01249dc4ce51 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:46.677291 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d8daf3c4-f11f-4cf7-bf3d-0570cef4b28c tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:46.921494 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d8daf3c4-f11f-4cf7-bf3d-0570cef4b28c tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:46.934183 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d8daf3c4-f11f-4cf7-bf3d-0570cef4b28c tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1313 microversion: 2.1 time: 0.298036 Dec 15 13:06:46.944524 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 312/567] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:46 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:46.958624 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f8ce3043-b975-4daa-ac89-d2e5f315c927 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:46.959245 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f8ce3043-b975-4daa-ac89-d2e5f315c927 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:46.965284 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f8ce3043-b975-4daa-ac89-d2e5f315c927 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:46.965735 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f8ce3043-b975-4daa-ac89-d2e5f315c927 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:46.966557 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f8ce3043-b975-4daa-ac89-d2e5f315c927 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:46.966988 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f8ce3043-b975-4daa-ac89-d2e5f315c927 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:47.052269 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-e12616db-38d9-4921-bd1d-01249dc4ce51 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:47.064263 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-e12616db-38d9-4921-bd1d-01249dc4ce51 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1709 microversion: 2.1 time: 0.454450 Dec 15 13:06:47.080935 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 256/568] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:46 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1709 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:47.080935 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-f286a7e6-01a8-4050-a56f-09fc2f598863 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:47.080935 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-f286a7e6-01a8-4050-a56f-09fc2f598863 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:47.081864 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f286a7e6-01a8-4050-a56f-09fc2f598863 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:47.082351 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f286a7e6-01a8-4050-a56f-09fc2f598863 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:47.083289 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f286a7e6-01a8-4050-a56f-09fc2f598863 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:47.084354 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f286a7e6-01a8-4050-a56f-09fc2f598863 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:47.123675 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f8ce3043-b975-4daa-ac89-d2e5f315c927 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:47.137585 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f8ce3043-b975-4daa-ac89-d2e5f315c927 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:47.140728 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f8ce3043-b975-4daa-ac89-d2e5f315c927 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:47.143219 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f8ce3043-b975-4daa-ac89-d2e5f315c927 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1751 microversion: 2.20 time: 0.197257 Dec 15 13:06:47.162677 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 313/569] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:46 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1751 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:06:47.235141 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-f286a7e6-01a8-4050-a56f-09fc2f598863 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:47.243397 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-f286a7e6-01a8-4050-a56f-09fc2f598863 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1318 microversion: 2.1 time: 0.172853 Dec 15 13:06:47.244020 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 257/570] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:47 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:47.535759 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a924d6b7-17ce-4329-99a7-81e0fd707853 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:47.536353 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a924d6b7-17ce-4329-99a7-81e0fd707853 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:47.542968 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a924d6b7-17ce-4329-99a7-81e0fd707853 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:47.543415 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a924d6b7-17ce-4329-99a7-81e0fd707853 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:47.544221 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a924d6b7-17ce-4329-99a7-81e0fd707853 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:47.544654 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a924d6b7-17ce-4329-99a7-81e0fd707853 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:47.560585 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-2412d0de-ffcd-41e9-ba6c-359139247d2a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:47.561935 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-2412d0de-ffcd-41e9-ba6c-359139247d2a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:47.571157 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2412d0de-ffcd-41e9-ba6c-359139247d2a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:47.571927 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2412d0de-ffcd-41e9-ba6c-359139247d2a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:47.573278 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2412d0de-ffcd-41e9-ba6c-359139247d2a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:47.574041 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2412d0de-ffcd-41e9-ba6c-359139247d2a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:47.711918 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a924d6b7-17ce-4329-99a7-81e0fd707853 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:47.720646 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a924d6b7-17ce-4329-99a7-81e0fd707853 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1592 microversion: 2.1 time: 0.188447 Dec 15 13:06:47.721275 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 314/571] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:47 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1592 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:47.727469 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-2412d0de-ffcd-41e9-ba6c-359139247d2a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:47.737738 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-2412d0de-ffcd-41e9-ba6c-359139247d2a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.181384 Dec 15 13:06:47.738993 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 258/572] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:47 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:47.955886 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e59dacca-ef7f-4a2b-b0ce-26f1dbc2ec6f tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:47.957699 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e59dacca-ef7f-4a2b-b0ce-26f1dbc2ec6f tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:47.969350 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e59dacca-ef7f-4a2b-b0ce-26f1dbc2ec6f tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:47.970375 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e59dacca-ef7f-4a2b-b0ce-26f1dbc2ec6f tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:47.972333 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e59dacca-ef7f-4a2b-b0ce-26f1dbc2ec6f tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:47.973481 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e59dacca-ef7f-4a2b-b0ce-26f1dbc2ec6f tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:48.105293 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-4c841fbd-b60f-464b-a327-e702b2091bfc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:48.107084 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-4c841fbd-b60f-464b-a327-e702b2091bfc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:48.129665 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4c841fbd-b60f-464b-a327-e702b2091bfc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:48.133543 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4c841fbd-b60f-464b-a327-e702b2091bfc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:48.135158 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4c841fbd-b60f-464b-a327-e702b2091bfc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:48.136738 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4c841fbd-b60f-464b-a327-e702b2091bfc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:48.312697 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e59dacca-ef7f-4a2b-b0ce-26f1dbc2ec6f tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:48.331307 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e59dacca-ef7f-4a2b-b0ce-26f1dbc2ec6f tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1313 microversion: 2.1 time: 0.382371 Dec 15 13:06:48.334199 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 315/573] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:47 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1313 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:48.350792 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-61139963-bcd0-4720-b843-2344c800aff4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:48.352343 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-61139963-bcd0-4720-b843-2344c800aff4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:48.361618 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-61139963-bcd0-4720-b843-2344c800aff4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:48.362823 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-61139963-bcd0-4720-b843-2344c800aff4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:48.364058 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-61139963-bcd0-4720-b843-2344c800aff4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:48.364361 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-61139963-bcd0-4720-b843-2344c800aff4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:48.519955 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-61139963-bcd0-4720-b843-2344c800aff4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:48.528610 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-61139963-bcd0-4720-b843-2344c800aff4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:48.530890 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-61139963-bcd0-4720-b843-2344c800aff4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:48.532024 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-61139963-bcd0-4720-b843-2344c800aff4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.198502 Dec 15 13:06:48.532588 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 316/574] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:48 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:06:48.536990 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5f437271-4e72-4674-af33-57ce32a8d54d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:48.538288 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5f437271-4e72-4674-af33-57ce32a8d54d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:48.545640 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5f437271-4e72-4674-af33-57ce32a8d54d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:48.546092 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5f437271-4e72-4674-af33-57ce32a8d54d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:48.546932 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5f437271-4e72-4674-af33-57ce32a8d54d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:48.547389 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5f437271-4e72-4674-af33-57ce32a8d54d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:48.565566 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-4c841fbd-b60f-464b-a327-e702b2091bfc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:48.574380 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-4c841fbd-b60f-464b-a327-e702b2091bfc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1709 microversion: 2.1 time: 0.486318 Dec 15 13:06:48.575278 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 259/575] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:48 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1709 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:48.585455 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-12596f8b-436f-4d8d-b01b-284cefb4627b req-56ae6b32-bbbd-4598-8474-288736eeee54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "902f62f8-3d70-4b3a-90a6-c924126e5300", "name": "network-vif-plugged", "status": "completed", "tag": "c3e32283-04ca-4ceb-90b7-6e2249b3c261"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:06:48.587166 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:06:48.587166 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:06:48.595028 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-12596f8b-436f-4d8d-b01b-284cefb4627b req-56ae6b32-bbbd-4598-8474-288736eeee54 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:48.595535 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-12596f8b-436f-4d8d-b01b-284cefb4627b req-56ae6b32-bbbd-4598-8474-288736eeee54 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:48.607441 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-12596f8b-436f-4d8d-b01b-284cefb4627b req-56ae6b32-bbbd-4598-8474-288736eeee54 service nova] Creating event network-vif-plugged:c3e32283-04ca-4ceb-90b7-6e2249b3c261 for instance 902f62f8-3d70-4b3a-90a6-c924126e5300 on hv-cinder-81322 Dec 15 13:06:48.613276 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-12596f8b-436f-4d8d-b01b-284cefb4627b req-56ae6b32-bbbd-4598-8474-288736eeee54 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036608 Dec 15 13:06:48.613880 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 260/576] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:06:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:06:48.697655 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5f437271-4e72-4674-af33-57ce32a8d54d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:48.705849 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5f437271-4e72-4674-af33-57ce32a8d54d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1318 microversion: 2.1 time: 0.172239 Dec 15 13:06:48.706466 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 317/577] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:48 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:48.763565 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-740cf8ff-505f-42bc-a550-06c6fc388d22 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:48.765041 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-740cf8ff-505f-42bc-a550-06c6fc388d22 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:48.772479 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-740cf8ff-505f-42bc-a550-06c6fc388d22 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:48.772871 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-740cf8ff-505f-42bc-a550-06c6fc388d22 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:48.773632 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-740cf8ff-505f-42bc-a550-06c6fc388d22 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:48.774064 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-740cf8ff-505f-42bc-a550-06c6fc388d22 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:49.079486 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-740cf8ff-505f-42bc-a550-06c6fc388d22 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:49.087103 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-740cf8ff-505f-42bc-a550-06c6fc388d22 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.329210 Dec 15 13:06:49.087665 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 261/578] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:48 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:49.352277 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7d51f515-bc86-4555-9d7d-2efbbf9e08d8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:49.352913 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7d51f515-bc86-4555-9d7d-2efbbf9e08d8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:49.359751 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7d51f515-bc86-4555-9d7d-2efbbf9e08d8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:49.360357 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7d51f515-bc86-4555-9d7d-2efbbf9e08d8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:49.361583 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7d51f515-bc86-4555-9d7d-2efbbf9e08d8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:49.362121 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7d51f515-bc86-4555-9d7d-2efbbf9e08d8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:49.519297 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-7d51f515-bc86-4555-9d7d-2efbbf9e08d8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:49.528661 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7d51f515-bc86-4555-9d7d-2efbbf9e08d8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1313 microversion: 2.1 time: 0.180676 Dec 15 13:06:49.529456 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 318/579] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:49 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:49.551563 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-07ce5133-e17f-42f3-89b1-351355afae47 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:49.552448 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-07ce5133-e17f-42f3-89b1-351355afae47 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:49.558368 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-07ce5133-e17f-42f3-89b1-351355afae47 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:49.558829 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-07ce5133-e17f-42f3-89b1-351355afae47 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:49.559622 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-07ce5133-e17f-42f3-89b1-351355afae47 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:49.560245 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-07ce5133-e17f-42f3-89b1-351355afae47 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:49.593205 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0c5f351d-8796-430c-9eed-12fa0933a9cb tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:49.593882 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0c5f351d-8796-430c-9eed-12fa0933a9cb tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:49.600190 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0c5f351d-8796-430c-9eed-12fa0933a9cb tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:49.600640 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0c5f351d-8796-430c-9eed-12fa0933a9cb tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:49.601536 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0c5f351d-8796-430c-9eed-12fa0933a9cb tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:49.602040 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0c5f351d-8796-430c-9eed-12fa0933a9cb tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:49.798716 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0c5f351d-8796-430c-9eed-12fa0933a9cb tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:49.826116 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-0c5f351d-8796-430c-9eed-12fa0933a9cb tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1713 microversion: 2.1 time: 0.237038 Dec 15 13:06:49.827721 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 319/580] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:49 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1713 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:49.839664 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7085d67f-eb8a-4e7e-bfe7-c7c9df41bac1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:49.839664 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7085d67f-eb8a-4e7e-bfe7-c7c9df41bac1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:49.845459 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7085d67f-eb8a-4e7e-bfe7-c7c9df41bac1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:49.852446 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7085d67f-eb8a-4e7e-bfe7-c7c9df41bac1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:49.853264 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7085d67f-eb8a-4e7e-bfe7-c7c9df41bac1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:49.853706 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7085d67f-eb8a-4e7e-bfe7-c7c9df41bac1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:49.956930 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-07ce5133-e17f-42f3-89b1-351355afae47 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:49.966053 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-07ce5133-e17f-42f3-89b1-351355afae47 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:49.968222 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-07ce5133-e17f-42f3-89b1-351355afae47 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:49.969416 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-07ce5133-e17f-42f3-89b1-351355afae47 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.421999 Dec 15 13:06:49.970356 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 262/581] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:49 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:06:50.046213 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-7085d67f-eb8a-4e7e-bfe7-c7c9df41bac1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:50.053755 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7085d67f-eb8a-4e7e-bfe7-c7c9df41bac1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1318 microversion: 2.1 time: 0.224775 Dec 15 13:06:50.054352 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 320/582] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:49 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:50.107524 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-562670c7-26cf-494a-85b9-bca5d94dd578 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:50.109159 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-562670c7-26cf-494a-85b9-bca5d94dd578 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:50.115161 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-562670c7-26cf-494a-85b9-bca5d94dd578 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:50.115691 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-562670c7-26cf-494a-85b9-bca5d94dd578 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:50.116543 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-562670c7-26cf-494a-85b9-bca5d94dd578 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:50.117054 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-562670c7-26cf-494a-85b9-bca5d94dd578 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:50.547019 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-38b6da7f-6cc6-4950-9e98-10929505a508 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:50.547906 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-38b6da7f-6cc6-4950-9e98-10929505a508 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:50.557644 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-38b6da7f-6cc6-4950-9e98-10929505a508 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:50.558100 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-38b6da7f-6cc6-4950-9e98-10929505a508 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:50.558922 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-38b6da7f-6cc6-4950-9e98-10929505a508 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:50.559362 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-38b6da7f-6cc6-4950-9e98-10929505a508 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:50.569614 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-562670c7-26cf-494a-85b9-bca5d94dd578 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:50.580016 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-562670c7-26cf-494a-85b9-bca5d94dd578 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.479211 Dec 15 13:06:50.590957 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 263/583] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:50 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:50.707307 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-38b6da7f-6cc6-4950-9e98-10929505a508 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:50.715866 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-39c81b0d-a5a6-415b-b767-561bc3fe3060 req-385df167-e038-42e2-acd5-6484c1248ecc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b62c709-a647-468b-bb79-1e1e20832c1e", "tag": "235d69ca-304f-4a79-a570-8c3fd9220dcf"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:06:50.718653 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:06:50.718653 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:06:50.722693 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-38b6da7f-6cc6-4950-9e98-10929505a508 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1313 microversion: 2.1 time: 0.179096 Dec 15 13:06:50.724540 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 321/584] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:50 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:50.727045 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-39c81b0d-a5a6-415b-b767-561bc3fe3060 req-385df167-e038-42e2-acd5-6484c1248ecc service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:50.727743 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-39c81b0d-a5a6-415b-b767-561bc3fe3060 req-385df167-e038-42e2-acd5-6484c1248ecc service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:50.739849 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-39c81b0d-a5a6-415b-b767-561bc3fe3060 req-385df167-e038-42e2-acd5-6484c1248ecc service nova] Creating event network-changed:235d69ca-304f-4a79-a570-8c3fd9220dcf for instance 5b62c709-a647-468b-bb79-1e1e20832c1e on hv-cinder-81322 Dec 15 13:06:50.745061 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-39c81b0d-a5a6-415b-b767-561bc3fe3060 req-385df167-e038-42e2-acd5-6484c1248ecc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033997 Dec 15 13:06:50.745818 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 264/585] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:06:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:06:50.995730 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-46a2bfb1-1469-42d4-953b-b18d73cbf8d9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:50.997769 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-46a2bfb1-1469-42d4-953b-b18d73cbf8d9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:51.010116 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-46a2bfb1-1469-42d4-953b-b18d73cbf8d9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:51.011237 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-46a2bfb1-1469-42d4-953b-b18d73cbf8d9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:51.013018 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-46a2bfb1-1469-42d4-953b-b18d73cbf8d9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:51.014124 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-46a2bfb1-1469-42d4-953b-b18d73cbf8d9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:51.101629 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-87cf646d-476f-45a3-b4cb-5b52b56cee66 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:51.102682 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-87cf646d-476f-45a3-b4cb-5b52b56cee66 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:51.112971 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-87cf646d-476f-45a3-b4cb-5b52b56cee66 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:51.114105 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-87cf646d-476f-45a3-b4cb-5b52b56cee66 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:51.115284 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-87cf646d-476f-45a3-b4cb-5b52b56cee66 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:51.116174 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-87cf646d-476f-45a3-b4cb-5b52b56cee66 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:51.232285 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-46a2bfb1-1469-42d4-953b-b18d73cbf8d9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:51.245843 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-46a2bfb1-1469-42d4-953b-b18d73cbf8d9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:51.247748 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-46a2bfb1-1469-42d4-953b-b18d73cbf8d9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:51.249486 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-46a2bfb1-1469-42d4-953b-b18d73cbf8d9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.260800 Dec 15 13:06:51.250673 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 322/586] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:50 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:06:51.310896 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-87cf646d-476f-45a3-b4cb-5b52b56cee66 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:51.323015 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-87cf646d-476f-45a3-b4cb-5b52b56cee66 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1318 microversion: 2.1 time: 0.251250 Dec 15 13:06:51.324122 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 265/587] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:51 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:51.603793 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-112e76ae-41bf-48fd-b4af-cf6370b8dcf6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:51.605385 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-112e76ae-41bf-48fd-b4af-cf6370b8dcf6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:51.617446 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-112e76ae-41bf-48fd-b4af-cf6370b8dcf6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:51.618376 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-112e76ae-41bf-48fd-b4af-cf6370b8dcf6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:51.621663 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-112e76ae-41bf-48fd-b4af-cf6370b8dcf6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:51.623193 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-112e76ae-41bf-48fd-b4af-cf6370b8dcf6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:51.749768 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-988c817c-4dd4-4b7c-8934-bf28b857e2e8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:51.754810 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-988c817c-4dd4-4b7c-8934-bf28b857e2e8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:51.780204 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-988c817c-4dd4-4b7c-8934-bf28b857e2e8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:51.780661 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-988c817c-4dd4-4b7c-8934-bf28b857e2e8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:51.781470 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-988c817c-4dd4-4b7c-8934-bf28b857e2e8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:51.781905 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-988c817c-4dd4-4b7c-8934-bf28b857e2e8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:51.979943 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-112e76ae-41bf-48fd-b4af-cf6370b8dcf6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:51.988518 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-112e76ae-41bf-48fd-b4af-cf6370b8dcf6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.390166 Dec 15 13:06:51.989103 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 323/588] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:51 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:52.077367 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-96d55722-53ca-4265-bc4d-004ae04d2391 req-98bc1756-f954-4e44-a1e7-c8d6a41d962b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "538de0dc-a820-43f0-8b8f-0966f219e960", "name": "network-vif-plugged", "status": "completed", "tag": "37796afb-3b88-4e52-8372-230d4df65445"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:06:52.080147 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:06:52.080147 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:06:52.095931 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-96d55722-53ca-4265-bc4d-004ae04d2391 req-98bc1756-f954-4e44-a1e7-c8d6a41d962b service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:52.098762 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-96d55722-53ca-4265-bc4d-004ae04d2391 req-98bc1756-f954-4e44-a1e7-c8d6a41d962b service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:52.129850 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-96d55722-53ca-4265-bc4d-004ae04d2391 req-98bc1756-f954-4e44-a1e7-c8d6a41d962b service nova] Creating event network-vif-plugged:37796afb-3b88-4e52-8372-230d4df65445 for instance 538de0dc-a820-43f0-8b8f-0966f219e960 on hv-cinder-81322 Dec 15 13:06:52.135491 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-96d55722-53ca-4265-bc4d-004ae04d2391 req-98bc1756-f954-4e44-a1e7-c8d6a41d962b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061712 Dec 15 13:06:52.136250 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 324/589] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:06:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:06:52.275936 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f6780270-7ba9-4559-b61a-83be990ab5c2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:52.276776 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f6780270-7ba9-4559-b61a-83be990ab5c2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:52.286926 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f6780270-7ba9-4559-b61a-83be990ab5c2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:52.287382 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f6780270-7ba9-4559-b61a-83be990ab5c2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:52.288199 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f6780270-7ba9-4559-b61a-83be990ab5c2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:52.288644 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f6780270-7ba9-4559-b61a-83be990ab5c2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:52.351544 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-988c817c-4dd4-4b7c-8934-bf28b857e2e8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:52.364144 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-988c817c-4dd4-4b7c-8934-bf28b857e2e8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1313 microversion: 2.1 time: 0.618218 Dec 15 13:06:52.380980 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 266/590] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:51 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1313 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:52.390967 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-d474b623-8985-4b00-9a64-28d821a6af44 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:52.392377 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-d474b623-8985-4b00-9a64-28d821a6af44 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:52.414124 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d474b623-8985-4b00-9a64-28d821a6af44 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:52.416110 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d474b623-8985-4b00-9a64-28d821a6af44 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:52.449211 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d474b623-8985-4b00-9a64-28d821a6af44 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:52.450407 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d474b623-8985-4b00-9a64-28d821a6af44 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:52.512241 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f6780270-7ba9-4559-b61a-83be990ab5c2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:52.525502 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f6780270-7ba9-4559-b61a-83be990ab5c2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:52.527721 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f6780270-7ba9-4559-b61a-83be990ab5c2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:52.529921 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f6780270-7ba9-4559-b61a-83be990ab5c2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.258773 Dec 15 13:06:52.530942 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 325/591] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:52 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:06:52.537013 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-27448828-3fd5-4e59-9dbf-8f3dfe1cb435 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2091972499"}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:06:52.538012 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-27448828-3fd5-4e59-9dbf-8f3dfe1cb435 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:52.544423 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-27448828-3fd5-4e59-9dbf-8f3dfe1cb435 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:52.545100 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-27448828-3fd5-4e59-9dbf-8f3dfe1cb435 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:52.546548 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-27448828-3fd5-4e59-9dbf-8f3dfe1cb435 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:52.547114 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-27448828-3fd5-4e59-9dbf-8f3dfe1cb435 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:52.734320 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-d474b623-8985-4b00-9a64-28d821a6af44 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:52.751360 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-d474b623-8985-4b00-9a64-28d821a6af44 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1318 microversion: 2.1 time: 0.367463 Dec 15 13:06:52.753558 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 267/592] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:52 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1318 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:52.768168 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-6b46c6e7-e197-47df-85c0-a1841ae478ed tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1739339407", "imageRef": "67890983-693f-44ed-bdf3-22321abeab26", "flavorRef": "452", "networks": [{"uuid": "c3430785-34d0-49f6-8e66-cf155a895b08"}]}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:06:52.795437 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.network.security_group_api [None req-27448828-3fd5-4e59-9dbf-8f3dfe1cb435 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Adding security group 54a9d2f6-271b-4168-a9b6-6db60024d842 to port 235d69ca-304f-4a79-a570-8c3fd9220dcf Dec 15 13:06:52.859610 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.network.neutron [None req-6b46c6e7-e197-47df-85c0-a1841ae478ed tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] validate_networks() for [('c3430785-34d0-49f6-8e66-cf155a895b08', None, None, None, None, None)] {{(pid=116097) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:06:53.376254 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-27448828-3fd5-4e59-9dbf-8f3dfe1cb435 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "POST /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e/action" status: 202 len: 0 microversion: 2.1 time: 0.843775 Dec 15 13:06:53.377526 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 326/593] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:06:52 2021] POST /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e/action => generated 0 bytes in 846 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:06:53.382512 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-6b46c6e7-e197-47df-85c0-a1841ae478ed tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Flavor limits 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:06:53.383325 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-6b46c6e7-e197-47df-85c0-a1841ae478ed tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Image limits 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:06:53.384146 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-6b46c6e7-e197-47df-85c0-a1841ae478ed tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Flavor pref 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:06:53.385499 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8b75eb21-6763-4b0d-9911-b9f439fd2b42 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:53.386071 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-6b46c6e7-e197-47df-85c0-a1841ae478ed tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Image pref 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:06:53.386213 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8b75eb21-6763-4b0d-9911-b9f439fd2b42 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:53.386872 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-6b46c6e7-e197-47df-85c0-a1841ae478ed tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:06:53.392175 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8b75eb21-6763-4b0d-9911-b9f439fd2b42 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:53.392884 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8b75eb21-6763-4b0d-9911-b9f439fd2b42 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:53.393842 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8b75eb21-6763-4b0d-9911-b9f439fd2b42 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:53.394323 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8b75eb21-6763-4b0d-9911-b9f439fd2b42 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:53.441615 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6b46c6e7-e197-47df-85c0-a1841ae478ed tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:53.442339 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6b46c6e7-e197-47df-85c0-a1841ae478ed tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:53.443617 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6b46c6e7-e197-47df-85c0-a1841ae478ed tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:53.444278 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6b46c6e7-e197-47df-85c0-a1841ae478ed tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:53.485387 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-6b46c6e7-e197-47df-85c0-a1841ae478ed tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Getting quotas for project e65fe36399a34538b3b4da9464f43df3. Resources: {'instances', 'cores', 'ram'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:06:53.494102 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-6b46c6e7-e197-47df-85c0-a1841ae478ed tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Getting quotas for user 047982e41574460caa4bf3b79a9a8370 and project e65fe36399a34538b3b4da9464f43df3. Resources: {'instances', 'cores', 'ram'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:06:53.515544 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-6b46c6e7-e197-47df-85c0-a1841ae478ed tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Going to run 1 instances... {{(pid=116097) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:06:53.520969 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-6b46c6e7-e197-47df-85c0-a1841ae478ed tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67890983-693f-44ed-bdf3-22321abeab26',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:06:53.613161 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8b75eb21-6763-4b0d-9911-b9f439fd2b42 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:53.622339 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8b75eb21-6763-4b0d-9911-b9f439fd2b42 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.243313 Dec 15 13:06:53.623194 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 327/594] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:53 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:53.630617 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-984c93be-b06f-4076-b26e-7f731d38ae67 req-ea7bb674-ef0b-4a89-b48f-8fe3fa8478e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b62c709-a647-468b-bb79-1e1e20832c1e", "tag": "235d69ca-304f-4a79-a570-8c3fd9220dcf"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:06:53.632130 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:06:53.632130 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:06:53.640084 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-984c93be-b06f-4076-b26e-7f731d38ae67 req-ea7bb674-ef0b-4a89-b48f-8fe3fa8478e5 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:53.640874 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-984c93be-b06f-4076-b26e-7f731d38ae67 req-ea7bb674-ef0b-4a89-b48f-8fe3fa8478e5 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:53.651132 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-6b46c6e7-e197-47df-85c0-a1841ae478ed tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.894480 Dec 15 13:06:53.659385 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 268/595] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Dec 15 13:06:52 2021] POST /compute/v2.1/servers => generated 380 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:06:53.662716 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-888afc5f-a475-4a8c-903e-fb194b38724e tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:53.665263 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-888afc5f-a475-4a8c-903e-fb194b38724e tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:53.665456 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-984c93be-b06f-4076-b26e-7f731d38ae67 req-ea7bb674-ef0b-4a89-b48f-8fe3fa8478e5 service nova] Creating event network-changed:235d69ca-304f-4a79-a570-8c3fd9220dcf for instance 5b62c709-a647-468b-bb79-1e1e20832c1e on hv-cinder-81322 Dec 15 13:06:53.678908 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-888afc5f-a475-4a8c-903e-fb194b38724e tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:53.679889 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-888afc5f-a475-4a8c-903e-fb194b38724e tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:53.681890 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-888afc5f-a475-4a8c-903e-fb194b38724e tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:53.682715 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-888afc5f-a475-4a8c-903e-fb194b38724e tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:53.688497 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-984c93be-b06f-4076-b26e-7f731d38ae67 req-ea7bb674-ef0b-4a89-b48f-8fe3fa8478e5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059339 Dec 15 13:06:53.689807 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 328/596] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:06:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:06:53.711315 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-21ab6fb1-a132-4649-af96-0d706367ad60 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:53.714127 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-21ab6fb1-a132-4649-af96-0d706367ad60 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:53.724507 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-21ab6fb1-a132-4649-af96-0d706367ad60 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:53.725582 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-21ab6fb1-a132-4649-af96-0d706367ad60 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:53.726769 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-21ab6fb1-a132-4649-af96-0d706367ad60 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:53.727504 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-21ab6fb1-a132-4649-af96-0d706367ad60 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:54.035020 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-888afc5f-a475-4a8c-903e-fb194b38724e tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:54.047198 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-21ab6fb1-a132-4649-af96-0d706367ad60 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:54.052752 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-888afc5f-a475-4a8c-903e-fb194b38724e tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1757 microversion: 2.1 time: 0.398889 Dec 15 13:06:54.054851 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-21ab6fb1-a132-4649-af96-0d706367ad60 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1313 microversion: 2.1 time: 0.357361 Dec 15 13:06:54.056586 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 329/597] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:53 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1313 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:54.063473 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a88f8e8e-b698-4fdb-815a-d6946bf2ceaa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:54.064343 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a88f8e8e-b698-4fdb-815a-d6946bf2ceaa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:54.071552 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a88f8e8e-b698-4fdb-815a-d6946bf2ceaa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:54.072225 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a88f8e8e-b698-4fdb-815a-d6946bf2ceaa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:54.073162 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a88f8e8e-b698-4fdb-815a-d6946bf2ceaa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:54.074067 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a88f8e8e-b698-4fdb-815a-d6946bf2ceaa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:54.099590 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 269/598] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:53 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1757 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:54.107129 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-b086a0d2-24bc-48c7-8c96-293d1d44d18f tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:54.107757 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-b086a0d2-24bc-48c7-8c96-293d1d44d18f tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:54.224087 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-b086a0d2-24bc-48c7-8c96-293d1d44d18f tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:54.231596 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-b086a0d2-24bc-48c7-8c96-293d1d44d18f tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1219 microversion: 2.1 time: 0.130842 Dec 15 13:06:54.241651 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 270/599] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:54 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1219 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:54.246438 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-a6021a74-b6c8-4344-810f-f96f241942db tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:54.248179 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-a6021a74-b6c8-4344-810f-f96f241942db tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:54.258078 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a6021a74-b6c8-4344-810f-f96f241942db tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:54.258583 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a6021a74-b6c8-4344-810f-f96f241942db tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:54.259407 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a6021a74-b6c8-4344-810f-f96f241942db tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:54.259850 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a6021a74-b6c8-4344-810f-f96f241942db tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:54.503365 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a88f8e8e-b698-4fdb-815a-d6946bf2ceaa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:54.534297 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a88f8e8e-b698-4fdb-815a-d6946bf2ceaa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:54.536726 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a88f8e8e-b698-4fdb-815a-d6946bf2ceaa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:54.539191 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a88f8e8e-b698-4fdb-815a-d6946bf2ceaa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.481456 Dec 15 13:06:54.539994 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 330/600] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:54 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:06:54.594637 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-a6021a74-b6c8-4344-810f-f96f241942db tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:54.604313 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-a6021a74-b6c8-4344-810f-f96f241942db tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1318 microversion: 2.1 time: 0.367129 Dec 15 13:06:54.604886 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 271/601] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:54 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1318 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:54.643742 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-54f38e17-c0a9-45aa-b521-3dd7ea544fd6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:54.644363 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-54f38e17-c0a9-45aa-b521-3dd7ea544fd6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:54.657389 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-54f38e17-c0a9-45aa-b521-3dd7ea544fd6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:54.659207 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-54f38e17-c0a9-45aa-b521-3dd7ea544fd6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:54.661538 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-54f38e17-c0a9-45aa-b521-3dd7ea544fd6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:54.663269 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-54f38e17-c0a9-45aa-b521-3dd7ea544fd6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:54.861688 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-54f38e17-c0a9-45aa-b521-3dd7ea544fd6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:54.870813 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-54f38e17-c0a9-45aa-b521-3dd7ea544fd6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.233821 Dec 15 13:06:54.871400 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 331/602] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:54 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:55.072559 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-86fa3824-85ee-433c-941c-5b053b6594fe tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:55.073208 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-86fa3824-85ee-433c-941c-5b053b6594fe tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:55.079696 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-86fa3824-85ee-433c-941c-5b053b6594fe tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:55.080137 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-86fa3824-85ee-433c-941c-5b053b6594fe tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:55.080899 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-86fa3824-85ee-433c-941c-5b053b6594fe tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:55.081327 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-86fa3824-85ee-433c-941c-5b053b6594fe tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:55.227425 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-86fa3824-85ee-433c-941c-5b053b6594fe tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:55.235294 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-86fa3824-85ee-433c-941c-5b053b6594fe tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1498 microversion: 2.1 time: 0.166409 Dec 15 13:06:55.235858 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 272/603] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:55 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1498 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:55.249615 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-efed24b0-56ee-4fce-b499-4762d4de53fe tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:55.250439 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-efed24b0-56ee-4fce-b499-4762d4de53fe tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:55.257063 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-efed24b0-56ee-4fce-b499-4762d4de53fe tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:55.257636 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-efed24b0-56ee-4fce-b499-4762d4de53fe tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:55.258553 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-efed24b0-56ee-4fce-b499-4762d4de53fe tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:55.259094 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-efed24b0-56ee-4fce-b499-4762d4de53fe tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:55.341220 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-efed24b0-56ee-4fce-b499-4762d4de53fe tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:55.348779 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-efed24b0-56ee-4fce-b499-4762d4de53fe tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1215 microversion: 2.1 time: 0.103815 Dec 15 13:06:55.349461 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 332/604] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:55 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1215 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:55.557706 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-693f4f2d-5d6d-4193-aaaf-9556ca19a659 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:55.558335 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-693f4f2d-5d6d-4193-aaaf-9556ca19a659 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:55.567714 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-693f4f2d-5d6d-4193-aaaf-9556ca19a659 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:55.568170 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-693f4f2d-5d6d-4193-aaaf-9556ca19a659 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:55.568957 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-693f4f2d-5d6d-4193-aaaf-9556ca19a659 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:55.569388 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-693f4f2d-5d6d-4193-aaaf-9556ca19a659 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:55.624585 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-62b56cbd-b002-43be-bffa-18c1f1ecbf54 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:55.625590 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-62b56cbd-b002-43be-bffa-18c1f1ecbf54 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:55.652442 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-62b56cbd-b002-43be-bffa-18c1f1ecbf54 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:55.652877 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-62b56cbd-b002-43be-bffa-18c1f1ecbf54 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:55.653873 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-62b56cbd-b002-43be-bffa-18c1f1ecbf54 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:55.654855 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-62b56cbd-b002-43be-bffa-18c1f1ecbf54 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:55.850595 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-693f4f2d-5d6d-4193-aaaf-9556ca19a659 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:55.855240 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-62b56cbd-b002-43be-bffa-18c1f1ecbf54 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:55.860010 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-693f4f2d-5d6d-4193-aaaf-9556ca19a659 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:55.861522 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-693f4f2d-5d6d-4193-aaaf-9556ca19a659 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:55.862912 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-693f4f2d-5d6d-4193-aaaf-9556ca19a659 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.308892 Dec 15 13:06:55.863063 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-62b56cbd-b002-43be-bffa-18c1f1ecbf54 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1318 microversion: 2.1 time: 0.243715 Dec 15 13:06:55.863774 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 273/605] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:55 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:06:55.864019 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 333/606] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:55 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:55.891767 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-9e4ad646-26cd-45a3-a2bc-b99b166943c4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:55.892891 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-9e4ad646-26cd-45a3-a2bc-b99b166943c4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:55.901855 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9e4ad646-26cd-45a3-a2bc-b99b166943c4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:55.903004 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9e4ad646-26cd-45a3-a2bc-b99b166943c4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:55.904302 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9e4ad646-26cd-45a3-a2bc-b99b166943c4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:55.905582 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9e4ad646-26cd-45a3-a2bc-b99b166943c4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:56.067040 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-9e4ad646-26cd-45a3-a2bc-b99b166943c4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:56.074604 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-9e4ad646-26cd-45a3-a2bc-b99b166943c4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.188912 Dec 15 13:06:56.075207 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 274/607] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:55 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:56.110329 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-78bd5bbc-c2fa-49af-8c61-376dbcdb4216 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:56.110820 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-78bd5bbc-c2fa-49af-8c61-376dbcdb4216 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:56.117355 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-78bd5bbc-c2fa-49af-8c61-376dbcdb4216 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:56.117794 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-78bd5bbc-c2fa-49af-8c61-376dbcdb4216 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:56.118604 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-78bd5bbc-c2fa-49af-8c61-376dbcdb4216 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:56.119033 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-78bd5bbc-c2fa-49af-8c61-376dbcdb4216 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:56.157975 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-78bd5bbc-c2fa-49af-8c61-376dbcdb4216 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Going to try to terminate instance {{(pid=116098) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:06:56.238396 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-78bd5bbc-c2fa-49af-8c61-376dbcdb4216 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "DELETE /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 204 len: 0 microversion: 2.1 time: 0.131690 Dec 15 13:06:56.238982 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 334/608] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Dec 15 13:06:56 2021] DELETE /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:06:56.247272 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-bcd60b9b-3e3a-4972-9755-d24c4fa2da86 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:56.247880 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-bcd60b9b-3e3a-4972-9755-d24c4fa2da86 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:56.254582 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-bcd60b9b-3e3a-4972-9755-d24c4fa2da86 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:56.255060 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-bcd60b9b-3e3a-4972-9755-d24c4fa2da86 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:56.255861 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-bcd60b9b-3e3a-4972-9755-d24c4fa2da86 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:56.256286 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-bcd60b9b-3e3a-4972-9755-d24c4fa2da86 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:56.372555 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-fbf5d836-217d-4c33-839b-b7587fb9bc26 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:56.373997 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-fbf5d836-217d-4c33-839b-b7587fb9bc26 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:56.379773 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fbf5d836-217d-4c33-839b-b7587fb9bc26 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:56.380212 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fbf5d836-217d-4c33-839b-b7587fb9bc26 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:56.380982 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fbf5d836-217d-4c33-839b-b7587fb9bc26 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:56.381442 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fbf5d836-217d-4c33-839b-b7587fb9bc26 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:56.399783 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-bcd60b9b-3e3a-4972-9755-d24c4fa2da86 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:56.407387 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-bcd60b9b-3e3a-4972-9755-d24c4fa2da86 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1504 microversion: 2.1 time: 0.163775 Dec 15 13:06:56.408069 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 275/609] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:56 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:56.457271 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-fbf5d836-217d-4c33-839b-b7587fb9bc26 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:56.464694 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-fbf5d836-217d-4c33-839b-b7587fb9bc26 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1215 microversion: 2.1 time: 0.096251 Dec 15 13:06:56.465272 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 335/610] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:56 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1215 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:56.882334 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-c5d32173-255a-41ec-ac9c-8b6b3ae74088 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:56.883316 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-c5d32173-255a-41ec-ac9c-8b6b3ae74088 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:56.886439 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4ea141b6-5715-4b45-8d65-644e3b0f8fae tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:56.887353 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4ea141b6-5715-4b45-8d65-644e3b0f8fae tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:56.893040 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c5d32173-255a-41ec-ac9c-8b6b3ae74088 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:56.893760 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c5d32173-255a-41ec-ac9c-8b6b3ae74088 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:56.895079 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c5d32173-255a-41ec-ac9c-8b6b3ae74088 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:56.895907 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c5d32173-255a-41ec-ac9c-8b6b3ae74088 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:56.898660 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4ea141b6-5715-4b45-8d65-644e3b0f8fae tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:56.899631 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4ea141b6-5715-4b45-8d65-644e3b0f8fae tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:56.901643 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4ea141b6-5715-4b45-8d65-644e3b0f8fae tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:56.903459 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4ea141b6-5715-4b45-8d65-644e3b0f8fae tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:57.089678 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-c5d32173-255a-41ec-ac9c-8b6b3ae74088 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:57.089946 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4ea141b6-5715-4b45-8d65-644e3b0f8fae tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:57.100145 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4ea141b6-5715-4b45-8d65-644e3b0f8fae tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:57.101968 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4ea141b6-5715-4b45-8d65-644e3b0f8fae tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:57.103175 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4ea141b6-5715-4b45-8d65-644e3b0f8fae tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.223118 Dec 15 13:06:57.103737 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 336/611] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:56 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:06:57.108882 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c9e4b1c2-6ddd-4485-ba11-d4769de5b39d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:57.109712 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c9e4b1c2-6ddd-4485-ba11-d4769de5b39d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:57.112387 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-c5d32173-255a-41ec-ac9c-8b6b3ae74088 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1318 microversion: 2.1 time: 0.234952 Dec 15 13:06:57.113827 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 276/612] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:56 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:57.129384 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c9e4b1c2-6ddd-4485-ba11-d4769de5b39d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:57.130308 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c9e4b1c2-6ddd-4485-ba11-d4769de5b39d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:57.131876 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c9e4b1c2-6ddd-4485-ba11-d4769de5b39d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:57.132782 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c9e4b1c2-6ddd-4485-ba11-d4769de5b39d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:57.284877 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c9e4b1c2-6ddd-4485-ba11-d4769de5b39d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:57.293216 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c9e4b1c2-6ddd-4485-ba11-d4769de5b39d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.188268 Dec 15 13:06:57.298190 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 337/613] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:57 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:57.425690 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-e79b9d00-a66f-4823-9a9d-85f494914e02 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:57.426328 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-e79b9d00-a66f-4823-9a9d-85f494914e02 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:57.433078 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e79b9d00-a66f-4823-9a9d-85f494914e02 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:57.433521 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e79b9d00-a66f-4823-9a9d-85f494914e02 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:57.434408 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e79b9d00-a66f-4823-9a9d-85f494914e02 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:57.434953 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e79b9d00-a66f-4823-9a9d-85f494914e02 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:57.481316 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f02ddc0a-ef0d-4db8-99bc-a019d2e78176 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:57.481928 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f02ddc0a-ef0d-4db8-99bc-a019d2e78176 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:57.488557 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f02ddc0a-ef0d-4db8-99bc-a019d2e78176 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:57.489010 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f02ddc0a-ef0d-4db8-99bc-a019d2e78176 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:57.489798 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f02ddc0a-ef0d-4db8-99bc-a019d2e78176 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:57.490257 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f02ddc0a-ef0d-4db8-99bc-a019d2e78176 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:57.608118 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-e79b9d00-a66f-4823-9a9d-85f494914e02 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:57.608533 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f02ddc0a-ef0d-4db8-99bc-a019d2e78176 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:57.615994 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f02ddc0a-ef0d-4db8-99bc-a019d2e78176 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1215 microversion: 2.1 time: 0.138408 Dec 15 13:06:57.616241 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-e79b9d00-a66f-4823-9a9d-85f494914e02 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1504 microversion: 2.1 time: 0.194034 Dec 15 13:06:57.616568 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 338/614] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:57 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1215 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:57.617742 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 277/615] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:57 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1504 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:58.123731 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-90bb0981-9c4a-446a-89de-ccfd732f71c8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:58.124524 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-90bb0981-9c4a-446a-89de-ccfd732f71c8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:58.131846 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-fae548a0-4e19-43c9-bc31-b5f6031027f5 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:58.132817 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-90bb0981-9c4a-446a-89de-ccfd732f71c8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:58.132817 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-90bb0981-9c4a-446a-89de-ccfd732f71c8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:58.133314 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-fae548a0-4e19-43c9-bc31-b5f6031027f5 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:58.133983 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-90bb0981-9c4a-446a-89de-ccfd732f71c8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:58.134736 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-90bb0981-9c4a-446a-89de-ccfd732f71c8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:58.146308 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fae548a0-4e19-43c9-bc31-b5f6031027f5 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:58.146759 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fae548a0-4e19-43c9-bc31-b5f6031027f5 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:58.147706 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fae548a0-4e19-43c9-bc31-b5f6031027f5 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:58.148172 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fae548a0-4e19-43c9-bc31-b5f6031027f5 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:58.310598 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-fae548a0-4e19-43c9-bc31-b5f6031027f5 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:58.315883 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-90bb0981-9c4a-446a-89de-ccfd732f71c8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:58.330533 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-90bb0981-9c4a-446a-89de-ccfd732f71c8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:58.332215 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-90bb0981-9c4a-446a-89de-ccfd732f71c8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:58.333408 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-90bb0981-9c4a-446a-89de-ccfd732f71c8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.213999 Dec 15 13:06:58.334185 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 339/616] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:58 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:06:58.338714 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-45b90b1e-cbdb-4100-9b2c-84e22cc1292b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:58.339319 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-45b90b1e-cbdb-4100-9b2c-84e22cc1292b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:58.347026 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-fae548a0-4e19-43c9-bc31-b5f6031027f5 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1318 microversion: 2.1 time: 0.206905 Dec 15 13:06:58.357945 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-45b90b1e-cbdb-4100-9b2c-84e22cc1292b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:58.357945 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-45b90b1e-cbdb-4100-9b2c-84e22cc1292b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:58.357945 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-45b90b1e-cbdb-4100-9b2c-84e22cc1292b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:58.357945 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-45b90b1e-cbdb-4100-9b2c-84e22cc1292b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:58.358475 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 278/617] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:58 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:58.508739 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-45b90b1e-cbdb-4100-9b2c-84e22cc1292b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:58.517879 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-45b90b1e-cbdb-4100-9b2c-84e22cc1292b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.182468 Dec 15 13:06:58.518494 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 340/618] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:58 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:58.639565 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-41cf047f-5a84-4b81-a132-8acbcbfa7205 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:58.640279 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-41cf047f-5a84-4b81-a132-8acbcbfa7205 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:58.644199 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e4a0e27b-0049-474e-9c6c-6294b7b1baef tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:58.644884 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e4a0e27b-0049-474e-9c6c-6294b7b1baef tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:58.647599 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-41cf047f-5a84-4b81-a132-8acbcbfa7205 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:58.648078 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-41cf047f-5a84-4b81-a132-8acbcbfa7205 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:58.649177 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-41cf047f-5a84-4b81-a132-8acbcbfa7205 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:58.649822 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-41cf047f-5a84-4b81-a132-8acbcbfa7205 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:58.651590 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e4a0e27b-0049-474e-9c6c-6294b7b1baef tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:58.652133 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e4a0e27b-0049-474e-9c6c-6294b7b1baef tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:58.653238 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e4a0e27b-0049-474e-9c6c-6294b7b1baef tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:58.653771 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e4a0e27b-0049-474e-9c6c-6294b7b1baef tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:58.737629 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-41cf047f-5a84-4b81-a132-8acbcbfa7205 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:58.746933 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-41cf047f-5a84-4b81-a132-8acbcbfa7205 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1215 microversion: 2.1 time: 0.111452 Dec 15 13:06:58.747834 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 279/619] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:58 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1215 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:58.821929 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e4a0e27b-0049-474e-9c6c-6294b7b1baef tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:58.833924 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e4a0e27b-0049-474e-9c6c-6294b7b1baef tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1504 microversion: 2.1 time: 0.193103 Dec 15 13:06:58.834961 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 341/620] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:58 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1504 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:59.365193 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-25362733-ff88-4ee9-bfc8-b8b1f108dc3e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:59.366387 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-25362733-ff88-4ee9-bfc8-b8b1f108dc3e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:59.370015 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-4c7a2a4e-f642-40fd-b692-49c9fe5b2b0d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:59.370861 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-4c7a2a4e-f642-40fd-b692-49c9fe5b2b0d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:59.377330 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-25362733-ff88-4ee9-bfc8-b8b1f108dc3e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:59.377812 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-25362733-ff88-4ee9-bfc8-b8b1f108dc3e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:59.378614 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-25362733-ff88-4ee9-bfc8-b8b1f108dc3e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:59.379144 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-25362733-ff88-4ee9-bfc8-b8b1f108dc3e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:59.383401 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4c7a2a4e-f642-40fd-b692-49c9fe5b2b0d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:59.383905 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4c7a2a4e-f642-40fd-b692-49c9fe5b2b0d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:59.384768 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4c7a2a4e-f642-40fd-b692-49c9fe5b2b0d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:59.385197 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4c7a2a4e-f642-40fd-b692-49c9fe5b2b0d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:59.550509 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-4c7a2a4e-f642-40fd-b692-49c9fe5b2b0d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:59.559795 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-4c7a2a4e-f642-40fd-b692-49c9fe5b2b0d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:59.562395 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-4c7a2a4e-f642-40fd-b692-49c9fe5b2b0d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:59.563850 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-4c7a2a4e-f642-40fd-b692-49c9fe5b2b0d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.206920 Dec 15 13:06:59.565037 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 280/621] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:06:59 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:06:59.569862 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-f97651db-65ea-40cb-ad28-cb9031394644 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:59.570801 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-f97651db-65ea-40cb-ad28-cb9031394644 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:59.577863 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f97651db-65ea-40cb-ad28-cb9031394644 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:59.578716 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f97651db-65ea-40cb-ad28-cb9031394644 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:59.580003 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f97651db-65ea-40cb-ad28-cb9031394644 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:59.580978 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f97651db-65ea-40cb-ad28-cb9031394644 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:59.605639 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-25362733-ff88-4ee9-bfc8-b8b1f108dc3e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:59.616836 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-25362733-ff88-4ee9-bfc8-b8b1f108dc3e tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1318 microversion: 2.1 time: 0.254843 Dec 15 13:06:59.626493 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 342/622] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:59 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:59.747734 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-f97651db-65ea-40cb-ad28-cb9031394644 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:59.761464 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-f97651db-65ea-40cb-ad28-cb9031394644 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.194596 Dec 15 13:06:59.762426 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 281/623] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:59 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:59.767850 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1688551a-3fee-4a14-a37a-bd27890fc014 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:59.768464 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1688551a-3fee-4a14-a37a-bd27890fc014 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:59.776175 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1688551a-3fee-4a14-a37a-bd27890fc014 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:59.776929 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1688551a-3fee-4a14-a37a-bd27890fc014 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:59.777743 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1688551a-3fee-4a14-a37a-bd27890fc014 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:59.778512 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1688551a-3fee-4a14-a37a-bd27890fc014 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:59.845145 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1688551a-3fee-4a14-a37a-bd27890fc014 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:59.852593 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1688551a-3fee-4a14-a37a-bd27890fc014 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1215 microversion: 2.1 time: 0.090230 Dec 15 13:06:59.853166 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 343/624] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:59 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1215 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:59.855875 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-2557cd67-c689-44e2-aba7-2f579d138bbe tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:59.856476 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-2557cd67-c689-44e2-aba7-2f579d138bbe tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:59.862545 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2557cd67-c689-44e2-aba7-2f579d138bbe tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:59.862989 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2557cd67-c689-44e2-aba7-2f579d138bbe tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:59.863761 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2557cd67-c689-44e2-aba7-2f579d138bbe tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:59.864185 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2557cd67-c689-44e2-aba7-2f579d138bbe tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:00.007028 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-2557cd67-c689-44e2-aba7-2f579d138bbe tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:00.015083 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-2557cd67-c689-44e2-aba7-2f579d138bbe tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1504 microversion: 2.1 time: 0.162709 Dec 15 13:07:00.015618 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 282/625] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:59 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:00.595641 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-34eddc75-e41a-4631-aa49-4c279c6f13e4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:00.596631 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-34eddc75-e41a-4631-aa49-4c279c6f13e4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:00.604823 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-34eddc75-e41a-4631-aa49-4c279c6f13e4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:00.605278 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-34eddc75-e41a-4631-aa49-4c279c6f13e4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:00.606175 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-34eddc75-e41a-4631-aa49-4c279c6f13e4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:00.606693 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-34eddc75-e41a-4631-aa49-4c279c6f13e4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:00.638477 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-74e54bd8-e404-486a-9c72-d5ce830ef54f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:00.640108 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-74e54bd8-e404-486a-9c72-d5ce830ef54f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:00.648038 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-74e54bd8-e404-486a-9c72-d5ce830ef54f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:00.649018 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-74e54bd8-e404-486a-9c72-d5ce830ef54f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:00.653176 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-74e54bd8-e404-486a-9c72-d5ce830ef54f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:00.653918 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-74e54bd8-e404-486a-9c72-d5ce830ef54f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:00.766945 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-34eddc75-e41a-4631-aa49-4c279c6f13e4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:00.776184 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-34eddc75-e41a-4631-aa49-4c279c6f13e4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:00.778169 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-34eddc75-e41a-4631-aa49-4c279c6f13e4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:00.780023 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-34eddc75-e41a-4631-aa49-4c279c6f13e4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.190364 Dec 15 13:07:00.780588 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 344/626] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:07:00 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:07:00.789235 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-788894fb-232e-4346-b6b6-2c8fbb7b5da4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:00.790113 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-788894fb-232e-4346-b6b6-2c8fbb7b5da4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:00.796568 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-788894fb-232e-4346-b6b6-2c8fbb7b5da4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:00.797033 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-788894fb-232e-4346-b6b6-2c8fbb7b5da4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:00.798064 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-788894fb-232e-4346-b6b6-2c8fbb7b5da4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:00.798559 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-788894fb-232e-4346-b6b6-2c8fbb7b5da4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:00.880495 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-74e54bd8-e404-486a-9c72-d5ce830ef54f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:00.893003 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-74e54bd8-e404-486a-9c72-d5ce830ef54f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1318 microversion: 2.1 time: 0.261113 Dec 15 13:07:00.894017 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 283/627] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:00 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:00.900037 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-85cb8566-aec5-4f92-b1aa-b4b51fb02cca tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:00.900919 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-85cb8566-aec5-4f92-b1aa-b4b51fb02cca tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:00.911315 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-85cb8566-aec5-4f92-b1aa-b4b51fb02cca tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:00.912085 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-85cb8566-aec5-4f92-b1aa-b4b51fb02cca tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:00.913447 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-85cb8566-aec5-4f92-b1aa-b4b51fb02cca tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:00.914186 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-85cb8566-aec5-4f92-b1aa-b4b51fb02cca tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:00.987127 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-788894fb-232e-4346-b6b6-2c8fbb7b5da4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:00.988358 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-85cb8566-aec5-4f92-b1aa-b4b51fb02cca tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:00.995583 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-788894fb-232e-4346-b6b6-2c8fbb7b5da4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.210061 Dec 15 13:07:00.995828 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-85cb8566-aec5-4f92-b1aa-b4b51fb02cca tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1215 microversion: 2.1 time: 0.100365 Dec 15 13:07:00.996523 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 284/629] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:00 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1215 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:01.002438 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 345/629] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:00 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:01.033093 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-fabe30de-1d64-4eee-869f-5be526c48a34 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:01.033742 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-fabe30de-1d64-4eee-869f-5be526c48a34 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:01.039847 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fabe30de-1d64-4eee-869f-5be526c48a34 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:01.040330 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fabe30de-1d64-4eee-869f-5be526c48a34 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:01.041131 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fabe30de-1d64-4eee-869f-5be526c48a34 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:01.041609 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fabe30de-1d64-4eee-869f-5be526c48a34 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:01.207054 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-fabe30de-1d64-4eee-869f-5be526c48a34 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:01.214368 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-fabe30de-1d64-4eee-869f-5be526c48a34 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1504 microversion: 2.1 time: 0.185617 Dec 15 13:07:01.214922 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 285/630] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:01 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1504 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:01.803487 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-dc026c6b-46d2-45e9-a5f0-0ecf02537bb9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:01.804218 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-dc026c6b-46d2-45e9-a5f0-0ecf02537bb9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:01.814840 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dc026c6b-46d2-45e9-a5f0-0ecf02537bb9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:01.815843 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dc026c6b-46d2-45e9-a5f0-0ecf02537bb9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:01.816861 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dc026c6b-46d2-45e9-a5f0-0ecf02537bb9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:01.817461 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dc026c6b-46d2-45e9-a5f0-0ecf02537bb9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:01.910203 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-eb1a1772-e15e-44bd-a912-d07e438b2c1d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:01.910979 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-eb1a1772-e15e-44bd-a912-d07e438b2c1d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:01.917219 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-eb1a1772-e15e-44bd-a912-d07e438b2c1d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:01.917672 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-eb1a1772-e15e-44bd-a912-d07e438b2c1d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:01.918493 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-eb1a1772-e15e-44bd-a912-d07e438b2c1d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:01.918934 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-eb1a1772-e15e-44bd-a912-d07e438b2c1d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:01.955921 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-dc026c6b-46d2-45e9-a5f0-0ecf02537bb9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:01.965685 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-dc026c6b-46d2-45e9-a5f0-0ecf02537bb9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:01.967563 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-dc026c6b-46d2-45e9-a5f0-0ecf02537bb9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:01.969479 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-dc026c6b-46d2-45e9-a5f0-0ecf02537bb9 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.174527 Dec 15 13:07:01.969479 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 346/631] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:07:01 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:07:02.012977 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-732fa298-fba4-4781-b2e0-ee50e76137c0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:02.014089 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-732fa298-fba4-4781-b2e0-ee50e76137c0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:02.022559 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-732fa298-fba4-4781-b2e0-ee50e76137c0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:02.023216 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-732fa298-fba4-4781-b2e0-ee50e76137c0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:02.024514 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-732fa298-fba4-4781-b2e0-ee50e76137c0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:02.025086 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-732fa298-fba4-4781-b2e0-ee50e76137c0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:02.084507 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-eb1a1772-e15e-44bd-a912-d07e438b2c1d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:02.092066 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-eb1a1772-e15e-44bd-a912-d07e438b2c1d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1318 microversion: 2.1 time: 0.185381 Dec 15 13:07:02.092659 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 286/632] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:01 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:02.097327 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-b3e9f57e-c80f-4c17-a768-794a20d18eab tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:02.097927 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-b3e9f57e-c80f-4c17-a768-794a20d18eab tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:02.104079 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b3e9f57e-c80f-4c17-a768-794a20d18eab tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:02.104545 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b3e9f57e-c80f-4c17-a768-794a20d18eab tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:02.105333 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b3e9f57e-c80f-4c17-a768-794a20d18eab tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:02.105763 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b3e9f57e-c80f-4c17-a768-794a20d18eab tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:02.125289 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-732fa298-fba4-4781-b2e0-ee50e76137c0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:02.136619 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-732fa298-fba4-4781-b2e0-ee50e76137c0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1215 microversion: 2.1 time: 0.127409 Dec 15 13:07:02.137808 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 347/633] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:02 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1215 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:02.233585 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ac19875b-bfe8-4b34-9393-6c35291bfe51 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:02.234210 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ac19875b-bfe8-4b34-9393-6c35291bfe51 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:02.240366 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ac19875b-bfe8-4b34-9393-6c35291bfe51 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:02.240819 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ac19875b-bfe8-4b34-9393-6c35291bfe51 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:02.241799 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ac19875b-bfe8-4b34-9393-6c35291bfe51 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:02.242276 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ac19875b-bfe8-4b34-9393-6c35291bfe51 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:02.290708 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-b3e9f57e-c80f-4c17-a768-794a20d18eab tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:02.298486 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-b3e9f57e-c80f-4c17-a768-794a20d18eab tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.204829 Dec 15 13:07:02.299056 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 287/634] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:02 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:02.620875 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ac19875b-bfe8-4b34-9393-6c35291bfe51 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:02.629297 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ac19875b-bfe8-4b34-9393-6c35291bfe51 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1504 microversion: 2.1 time: 0.399707 Dec 15 13:07:02.630027 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 348/635] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:02 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1504 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:02.986801 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-2028aa62-43bf-4b67-964a-3e1963ec8055 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:02.987407 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-2028aa62-43bf-4b67-964a-3e1963ec8055 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:02.993733 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2028aa62-43bf-4b67-964a-3e1963ec8055 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:02.994193 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2028aa62-43bf-4b67-964a-3e1963ec8055 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:02.994965 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2028aa62-43bf-4b67-964a-3e1963ec8055 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:02.995396 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2028aa62-43bf-4b67-964a-3e1963ec8055 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:03.113507 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-df617bb5-429a-4cdf-b336-494e48da68b6 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:03.114195 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-df617bb5-429a-4cdf-b336-494e48da68b6 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:03.121170 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-df617bb5-429a-4cdf-b336-494e48da68b6 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:03.121684 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-df617bb5-429a-4cdf-b336-494e48da68b6 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:03.123087 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-df617bb5-429a-4cdf-b336-494e48da68b6 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:03.123589 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-df617bb5-429a-4cdf-b336-494e48da68b6 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:03.136336 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-2028aa62-43bf-4b67-964a-3e1963ec8055 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:03.145938 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-2028aa62-43bf-4b67-964a-3e1963ec8055 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:03.147470 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-2028aa62-43bf-4b67-964a-3e1963ec8055 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:03.148651 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-2028aa62-43bf-4b67-964a-3e1963ec8055 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.165623 Dec 15 13:07:03.149365 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 288/636] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:07:02 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:07:03.161796 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-40a45720-b6d3-467c-9310-7e6d32e6a255 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:03.163271 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-40a45720-b6d3-467c-9310-7e6d32e6a255 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:03.169748 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-40a45720-b6d3-467c-9310-7e6d32e6a255 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:03.170744 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-40a45720-b6d3-467c-9310-7e6d32e6a255 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:03.172045 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-40a45720-b6d3-467c-9310-7e6d32e6a255 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:03.172975 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-40a45720-b6d3-467c-9310-7e6d32e6a255 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:03.245777 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-40a45720-b6d3-467c-9310-7e6d32e6a255 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:03.253582 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-40a45720-b6d3-467c-9310-7e6d32e6a255 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1215 microversion: 2.1 time: 0.096023 Dec 15 13:07:03.254380 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 289/637] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:03 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1215 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:03.281044 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-df617bb5-429a-4cdf-b336-494e48da68b6 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:03.288644 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-df617bb5-429a-4cdf-b336-494e48da68b6 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1318 microversion: 2.1 time: 0.179218 Dec 15 13:07:03.289282 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 349/638] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:03 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:03.319256 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-0a5cf7e9-a762-4053-a55c-a13fdf51e860 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:03.320274 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-0a5cf7e9-a762-4053-a55c-a13fdf51e860 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:03.327771 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0a5cf7e9-a762-4053-a55c-a13fdf51e860 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:03.328219 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0a5cf7e9-a762-4053-a55c-a13fdf51e860 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:03.329029 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0a5cf7e9-a762-4053-a55c-a13fdf51e860 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:03.329453 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0a5cf7e9-a762-4053-a55c-a13fdf51e860 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:03.472397 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-0a5cf7e9-a762-4053-a55c-a13fdf51e860 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:03.480399 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-0a5cf7e9-a762-4053-a55c-a13fdf51e860 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.167763 Dec 15 13:07:03.480978 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 290/639] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:03 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:03.652705 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-68d2f583-a715-4c97-a5ba-f494ffec74b3 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:03.653961 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-68d2f583-a715-4c97-a5ba-f494ffec74b3 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:03.664311 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-68d2f583-a715-4c97-a5ba-f494ffec74b3 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:03.664993 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-68d2f583-a715-4c97-a5ba-f494ffec74b3 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:03.666202 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-68d2f583-a715-4c97-a5ba-f494ffec74b3 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:03.666721 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-68d2f583-a715-4c97-a5ba-f494ffec74b3 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:03.820473 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-68d2f583-a715-4c97-a5ba-f494ffec74b3 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:03.833734 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-68d2f583-a715-4c97-a5ba-f494ffec74b3 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1504 microversion: 2.1 time: 0.189452 Dec 15 13:07:03.834365 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 350/640] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:03 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1504 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:04.180106 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-adcaf9f6-1cd7-4c53-b497-ab8d79d924af tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:04.181184 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-adcaf9f6-1cd7-4c53-b497-ab8d79d924af tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:04.188466 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-adcaf9f6-1cd7-4c53-b497-ab8d79d924af tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:04.188908 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-adcaf9f6-1cd7-4c53-b497-ab8d79d924af tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:04.189707 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-adcaf9f6-1cd7-4c53-b497-ab8d79d924af tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:04.190163 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-adcaf9f6-1cd7-4c53-b497-ab8d79d924af tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:04.275833 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9c870c9d-56c6-4ccb-83de-8246c22e392f tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:04.279409 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9c870c9d-56c6-4ccb-83de-8246c22e392f tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:04.291032 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9c870c9d-56c6-4ccb-83de-8246c22e392f tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:04.291638 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9c870c9d-56c6-4ccb-83de-8246c22e392f tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:04.292588 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9c870c9d-56c6-4ccb-83de-8246c22e392f tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:04.293477 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9c870c9d-56c6-4ccb-83de-8246c22e392f tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:04.374054 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-9c870c9d-56c6-4ccb-83de-8246c22e392f tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:04.383157 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9c870c9d-56c6-4ccb-83de-8246c22e392f tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1215 microversion: 2.1 time: 0.116034 Dec 15 13:07:04.383826 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 351/641] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:04 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1215 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:04.388043 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-adcaf9f6-1cd7-4c53-b497-ab8d79d924af tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:04.390176 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5ca27443-3f9f-4090-a99d-fa4d2861ce9f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:04.390799 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5ca27443-3f9f-4090-a99d-fa4d2861ce9f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:04.397750 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5ca27443-3f9f-4090-a99d-fa4d2861ce9f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:04.398488 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5ca27443-3f9f-4090-a99d-fa4d2861ce9f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:04.399622 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-adcaf9f6-1cd7-4c53-b497-ab8d79d924af tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:04.399853 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5ca27443-3f9f-4090-a99d-fa4d2861ce9f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:04.400442 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5ca27443-3f9f-4090-a99d-fa4d2861ce9f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:04.401300 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-adcaf9f6-1cd7-4c53-b497-ab8d79d924af tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:04.402672 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-adcaf9f6-1cd7-4c53-b497-ab8d79d924af tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.226405 Dec 15 13:07:04.403518 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 291/642] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:07:04 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:07:04.500221 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-86e2ace8-b1de-4709-a08e-eee6aac8c8d4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:04.501165 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-86e2ace8-b1de-4709-a08e-eee6aac8c8d4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:04.507357 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-86e2ace8-b1de-4709-a08e-eee6aac8c8d4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:04.507827 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-86e2ace8-b1de-4709-a08e-eee6aac8c8d4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:04.508605 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-86e2ace8-b1de-4709-a08e-eee6aac8c8d4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:04.509028 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-86e2ace8-b1de-4709-a08e-eee6aac8c8d4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:04.560906 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5ca27443-3f9f-4090-a99d-fa4d2861ce9f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:04.569197 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5ca27443-3f9f-4090-a99d-fa4d2861ce9f tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1318 microversion: 2.1 time: 0.184304 Dec 15 13:07:04.569779 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 352/643] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:04 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:04.675688 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-86e2ace8-b1de-4709-a08e-eee6aac8c8d4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:04.682914 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-86e2ace8-b1de-4709-a08e-eee6aac8c8d4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.189310 Dec 15 13:07:04.683479 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 292/644] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:04 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:04.851373 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1660b7b8-a398-449a-abe7-8ea0b59c88f6 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:04.852009 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1660b7b8-a398-449a-abe7-8ea0b59c88f6 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:04.858369 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1660b7b8-a398-449a-abe7-8ea0b59c88f6 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:04.858811 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1660b7b8-a398-449a-abe7-8ea0b59c88f6 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:04.859606 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1660b7b8-a398-449a-abe7-8ea0b59c88f6 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:04.860030 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1660b7b8-a398-449a-abe7-8ea0b59c88f6 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:05.012796 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1660b7b8-a398-449a-abe7-8ea0b59c88f6 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:05.026077 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1660b7b8-a398-449a-abe7-8ea0b59c88f6 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1504 microversion: 2.1 time: 0.177889 Dec 15 13:07:05.043766 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 353/645] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:04 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1504 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:05.400769 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-cb0d5272-eac8-4d23-914d-4d21facb520b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:05.401651 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-cb0d5272-eac8-4d23-914d-4d21facb520b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:05.408514 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cb0d5272-eac8-4d23-914d-4d21facb520b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:05.408956 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cb0d5272-eac8-4d23-914d-4d21facb520b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:05.409754 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cb0d5272-eac8-4d23-914d-4d21facb520b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:05.410210 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cb0d5272-eac8-4d23-914d-4d21facb520b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:05.422483 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-97b339b5-d7d4-4ea2-9998-6937aa4e7282 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:05.423255 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-97b339b5-d7d4-4ea2-9998-6937aa4e7282 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:05.433174 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-97b339b5-d7d4-4ea2-9998-6937aa4e7282 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:05.433622 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-97b339b5-d7d4-4ea2-9998-6937aa4e7282 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:05.434649 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-97b339b5-d7d4-4ea2-9998-6937aa4e7282 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:05.435771 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-97b339b5-d7d4-4ea2-9998-6937aa4e7282 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:05.496789 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-cb0d5272-eac8-4d23-914d-4d21facb520b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:05.505179 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-cb0d5272-eac8-4d23-914d-4d21facb520b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1215 microversion: 2.1 time: 0.108292 Dec 15 13:07:05.515571 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 293/646] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:05 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1215 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:05.593124 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-a485a9ae-4161-41aa-977e-43cd80e10ee7 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:05.593751 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-a485a9ae-4161-41aa-977e-43cd80e10ee7 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:05.608567 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a485a9ae-4161-41aa-977e-43cd80e10ee7 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:05.609028 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a485a9ae-4161-41aa-977e-43cd80e10ee7 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:05.609836 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a485a9ae-4161-41aa-977e-43cd80e10ee7 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:05.610318 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a485a9ae-4161-41aa-977e-43cd80e10ee7 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:05.706970 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-97b339b5-d7d4-4ea2-9998-6937aa4e7282 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:05.727827 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-97b339b5-d7d4-4ea2-9998-6937aa4e7282 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:05.730787 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-97b339b5-d7d4-4ea2-9998-6937aa4e7282 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:05.732810 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-97b339b5-d7d4-4ea2-9998-6937aa4e7282 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.314693 Dec 15 13:07:05.733678 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 354/647] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:07:05 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:07:05.743403 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-43a2c952-73c7-4ddb-b8cd-44d376d3e18f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:05.744594 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-43a2c952-73c7-4ddb-b8cd-44d376d3e18f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:05.755345 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-43a2c952-73c7-4ddb-b8cd-44d376d3e18f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:05.755918 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-43a2c952-73c7-4ddb-b8cd-44d376d3e18f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:05.757191 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-43a2c952-73c7-4ddb-b8cd-44d376d3e18f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:05.757753 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-43a2c952-73c7-4ddb-b8cd-44d376d3e18f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:05.788785 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-a485a9ae-4161-41aa-977e-43cd80e10ee7 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:05.798168 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-a485a9ae-4161-41aa-977e-43cd80e10ee7 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1318 microversion: 2.1 time: 0.209524 Dec 15 13:07:05.808132 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 294/648] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:05 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:05.970130 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-43a2c952-73c7-4ddb-b8cd-44d376d3e18f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:05.982853 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-43a2c952-73c7-4ddb-b8cd-44d376d3e18f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.247011 Dec 15 13:07:05.983948 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 355/649] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:05 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:06.047725 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-a8115a18-dd97-41c7-b17c-d8f939bd51c8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:06.048717 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-a8115a18-dd97-41c7-b17c-d8f939bd51c8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:06.057632 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a8115a18-dd97-41c7-b17c-d8f939bd51c8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:06.058351 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a8115a18-dd97-41c7-b17c-d8f939bd51c8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:06.059801 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a8115a18-dd97-41c7-b17c-d8f939bd51c8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:06.060999 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a8115a18-dd97-41c7-b17c-d8f939bd51c8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:06.221985 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-a8115a18-dd97-41c7-b17c-d8f939bd51c8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:06.229543 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-a8115a18-dd97-41c7-b17c-d8f939bd51c8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1504 microversion: 2.1 time: 0.187995 Dec 15 13:07:06.230107 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 295/650] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:06 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1504 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:06.523435 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-94710d7a-60db-4cf5-91c3-0583f6c572ff tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:06.524246 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-94710d7a-60db-4cf5-91c3-0583f6c572ff tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:06.533817 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-94710d7a-60db-4cf5-91c3-0583f6c572ff tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:06.534280 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-94710d7a-60db-4cf5-91c3-0583f6c572ff tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:06.535101 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-94710d7a-60db-4cf5-91c3-0583f6c572ff tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:06.535568 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-94710d7a-60db-4cf5-91c3-0583f6c572ff tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:06.611476 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-94710d7a-60db-4cf5-91c3-0583f6c572ff tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:06.624919 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-94710d7a-60db-4cf5-91c3-0583f6c572ff tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1215 microversion: 2.1 time: 0.105094 Dec 15 13:07:06.626059 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 356/651] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:06 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1215 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:06.767390 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-8dd326f7-1036-4bb8-b79c-a9b398e1db15 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:06.769031 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-8dd326f7-1036-4bb8-b79c-a9b398e1db15 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:06.781552 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8dd326f7-1036-4bb8-b79c-a9b398e1db15 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:06.782862 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8dd326f7-1036-4bb8-b79c-a9b398e1db15 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:06.785207 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8dd326f7-1036-4bb8-b79c-a9b398e1db15 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:06.786967 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8dd326f7-1036-4bb8-b79c-a9b398e1db15 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:06.825839 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-46f20cb6-55fa-42d9-af43-b43a1e8baf18 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:06.826916 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-46f20cb6-55fa-42d9-af43-b43a1e8baf18 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:06.836466 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-46f20cb6-55fa-42d9-af43-b43a1e8baf18 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:06.837213 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-46f20cb6-55fa-42d9-af43-b43a1e8baf18 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:06.838560 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-46f20cb6-55fa-42d9-af43-b43a1e8baf18 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:06.839308 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-46f20cb6-55fa-42d9-af43-b43a1e8baf18 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:07.032743 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-8dd326f7-1036-4bb8-b79c-a9b398e1db15 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:07.048964 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-8dd326f7-1036-4bb8-b79c-a9b398e1db15 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:07.052223 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-8dd326f7-1036-4bb8-b79c-a9b398e1db15 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:07.054732 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-8dd326f7-1036-4bb8-b79c-a9b398e1db15 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.296322 Dec 15 13:07:07.056414 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 296/652] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:07:06 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:07:07.059434 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-46f20cb6-55fa-42d9-af43-b43a1e8baf18 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:07.065339 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-dd7623b2-db06-4d65-8db2-69bb50617b19 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:07.067119 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-dd7623b2-db06-4d65-8db2-69bb50617b19 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:07.074821 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-46f20cb6-55fa-42d9-af43-b43a1e8baf18 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1318 microversion: 2.1 time: 0.254786 Dec 15 13:07:07.078212 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 357/653] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:06 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:07.081558 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dd7623b2-db06-4d65-8db2-69bb50617b19 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:07.082053 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dd7623b2-db06-4d65-8db2-69bb50617b19 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:07.082850 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dd7623b2-db06-4d65-8db2-69bb50617b19 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:07.083326 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dd7623b2-db06-4d65-8db2-69bb50617b19 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:07.244892 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-dd7623b2-db06-4d65-8db2-69bb50617b19 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:07.246197 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9720b94d-da82-439f-82bf-a87bdcf18cd8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:07.246815 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9720b94d-da82-439f-82bf-a87bdcf18cd8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:07.253158 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9720b94d-da82-439f-82bf-a87bdcf18cd8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:07.253609 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9720b94d-da82-439f-82bf-a87bdcf18cd8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:07.253792 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-dd7623b2-db06-4d65-8db2-69bb50617b19 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.195479 Dec 15 13:07:07.254373 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 297/654] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:07 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:07.254560 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9720b94d-da82-439f-82bf-a87bdcf18cd8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:07.254936 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9720b94d-da82-439f-82bf-a87bdcf18cd8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:07.403044 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-9720b94d-da82-439f-82bf-a87bdcf18cd8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:07.411962 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9720b94d-da82-439f-82bf-a87bdcf18cd8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1504 microversion: 2.1 time: 0.169073 Dec 15 13:07:07.420240 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 358/655] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:07 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:07.642593 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-01bef6da-9c3c-4f7f-9a0c-233ab1fede22 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:07.643222 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-01bef6da-9c3c-4f7f-9a0c-233ab1fede22 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:07.649098 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-01bef6da-9c3c-4f7f-9a0c-233ab1fede22 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:07.649548 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-01bef6da-9c3c-4f7f-9a0c-233ab1fede22 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:07.650367 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-01bef6da-9c3c-4f7f-9a0c-233ab1fede22 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:07.650811 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-01bef6da-9c3c-4f7f-9a0c-233ab1fede22 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:07.711580 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-01bef6da-9c3c-4f7f-9a0c-233ab1fede22 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:07.721685 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-01bef6da-9c3c-4f7f-9a0c-233ab1fede22 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1215 microversion: 2.1 time: 0.082959 Dec 15 13:07:07.722299 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 298/656] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:07 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1215 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:08.086343 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1ed68743-2e6b-4c17-af24-d03553a24402 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:08.087487 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1ed68743-2e6b-4c17-af24-d03553a24402 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:08.100324 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1ed68743-2e6b-4c17-af24-d03553a24402 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:08.100685 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-794911eb-6629-45fb-a0d7-8cdf0edd8c83 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:08.101431 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1ed68743-2e6b-4c17-af24-d03553a24402 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:08.101662 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1ed68743-2e6b-4c17-af24-d03553a24402 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:08.102207 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1ed68743-2e6b-4c17-af24-d03553a24402 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:08.103480 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-794911eb-6629-45fb-a0d7-8cdf0edd8c83 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:08.120349 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-794911eb-6629-45fb-a0d7-8cdf0edd8c83 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:08.120801 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-794911eb-6629-45fb-a0d7-8cdf0edd8c83 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:08.121623 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-794911eb-6629-45fb-a0d7-8cdf0edd8c83 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:08.127774 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-794911eb-6629-45fb-a0d7-8cdf0edd8c83 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:08.255509 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1ed68743-2e6b-4c17-af24-d03553a24402 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:08.264593 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1ed68743-2e6b-4c17-af24-d03553a24402 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:08.266252 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1ed68743-2e6b-4c17-af24-d03553a24402 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:08.267702 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1ed68743-2e6b-4c17-af24-d03553a24402 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.188065 Dec 15 13:07:08.268271 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 359/657] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:07:08 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:07:08.272722 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-074826f3-985c-447e-a41f-30603be05704 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:08.273889 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-074826f3-985c-447e-a41f-30603be05704 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:08.281266 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-074826f3-985c-447e-a41f-30603be05704 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:08.281723 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-074826f3-985c-447e-a41f-30603be05704 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:08.282558 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-074826f3-985c-447e-a41f-30603be05704 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:08.283026 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-074826f3-985c-447e-a41f-30603be05704 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:08.304967 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-794911eb-6629-45fb-a0d7-8cdf0edd8c83 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:08.321881 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-794911eb-6629-45fb-a0d7-8cdf0edd8c83 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1318 microversion: 2.1 time: 0.228559 Dec 15 13:07:08.325587 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 299/658] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:08 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:08.437803 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-7c83ee7e-a698-4f40-924e-93783dd6b76b tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:08.438448 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-7c83ee7e-a698-4f40-924e-93783dd6b76b tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:08.438959 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-074826f3-985c-447e-a41f-30603be05704 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:08.446245 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7c83ee7e-a698-4f40-924e-93783dd6b76b tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:08.447292 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7c83ee7e-a698-4f40-924e-93783dd6b76b tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:08.448709 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7c83ee7e-a698-4f40-924e-93783dd6b76b tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:08.449507 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7c83ee7e-a698-4f40-924e-93783dd6b76b tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:08.450044 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-074826f3-985c-447e-a41f-30603be05704 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.180454 Dec 15 13:07:08.451852 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 360/659] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:08 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:08.607972 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-7c83ee7e-a698-4f40-924e-93783dd6b76b tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:08.615714 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-7c83ee7e-a698-4f40-924e-93783dd6b76b tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1504 microversion: 2.1 time: 0.182035 Dec 15 13:07:08.616293 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 300/660] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:08 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1504 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:08.739200 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ab408b56-e2df-49d4-b3da-c01145b0fac3 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:08.739830 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ab408b56-e2df-49d4-b3da-c01145b0fac3 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:08.746491 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ab408b56-e2df-49d4-b3da-c01145b0fac3 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:08.746930 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ab408b56-e2df-49d4-b3da-c01145b0fac3 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:08.747713 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ab408b56-e2df-49d4-b3da-c01145b0fac3 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:08.749548 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ab408b56-e2df-49d4-b3da-c01145b0fac3 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:08.820888 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ab408b56-e2df-49d4-b3da-c01145b0fac3 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:08.833352 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ab408b56-e2df-49d4-b3da-c01145b0fac3 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1215 microversion: 2.1 time: 0.097731 Dec 15 13:07:08.834178 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 361/661] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:08 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1215 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:09.293019 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-f0082cdb-688a-4493-93f0-999eed977647 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:09.293975 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-f0082cdb-688a-4493-93f0-999eed977647 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:09.300956 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f0082cdb-688a-4493-93f0-999eed977647 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:09.301410 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f0082cdb-688a-4493-93f0-999eed977647 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:09.302223 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f0082cdb-688a-4493-93f0-999eed977647 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:09.302666 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f0082cdb-688a-4493-93f0-999eed977647 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:09.342590 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-3071a0ce-762e-4843-8a48-f8e11858cc50 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:09.343531 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-3071a0ce-762e-4843-8a48-f8e11858cc50 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:09.350766 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3071a0ce-762e-4843-8a48-f8e11858cc50 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:09.351349 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3071a0ce-762e-4843-8a48-f8e11858cc50 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:09.352252 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3071a0ce-762e-4843-8a48-f8e11858cc50 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:09.352794 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3071a0ce-762e-4843-8a48-f8e11858cc50 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:09.471596 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-f0082cdb-688a-4493-93f0-999eed977647 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:09.483074 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-f0082cdb-688a-4493-93f0-999eed977647 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:09.484818 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-f0082cdb-688a-4493-93f0-999eed977647 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:09.486002 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-f0082cdb-688a-4493-93f0-999eed977647 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.196796 Dec 15 13:07:09.486630 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 301/662] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:07:09 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:07:09.491208 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-7f4ba579-0d34-4754-98b6-c0eb7d7fa6bd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:09.491815 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-7f4ba579-0d34-4754-98b6-c0eb7d7fa6bd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:09.507496 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7f4ba579-0d34-4754-98b6-c0eb7d7fa6bd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:09.508016 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7f4ba579-0d34-4754-98b6-c0eb7d7fa6bd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:09.508821 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7f4ba579-0d34-4754-98b6-c0eb7d7fa6bd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:09.509265 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7f4ba579-0d34-4754-98b6-c0eb7d7fa6bd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:09.538778 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-3071a0ce-762e-4843-8a48-f8e11858cc50 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:09.549893 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-3071a0ce-762e-4843-8a48-f8e11858cc50 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1318 microversion: 2.1 time: 0.211430 Dec 15 13:07:09.550885 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 362/663] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:09 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:09.633877 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1c01f336-7c51-4c79-a262-067c680972f8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:09.634515 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1c01f336-7c51-4c79-a262-067c680972f8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:09.641720 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1c01f336-7c51-4c79-a262-067c680972f8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:09.642556 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1c01f336-7c51-4c79-a262-067c680972f8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:09.643403 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1c01f336-7c51-4c79-a262-067c680972f8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:09.643990 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1c01f336-7c51-4c79-a262-067c680972f8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:09.683897 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-7f4ba579-0d34-4754-98b6-c0eb7d7fa6bd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:09.692125 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-7f4ba579-0d34-4754-98b6-c0eb7d7fa6bd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.204473 Dec 15 13:07:09.692699 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 302/664] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:09 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:09.785122 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1c01f336-7c51-4c79-a262-067c680972f8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:09.793023 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1c01f336-7c51-4c79-a262-067c680972f8 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1504 microversion: 2.1 time: 0.163001 Dec 15 13:07:09.794705 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 363/665] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:09 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:09.851441 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-19824ab5-b7ed-427f-94f2-88063ee7ef59 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:09.852034 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-19824ab5-b7ed-427f-94f2-88063ee7ef59 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:09.858864 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-19824ab5-b7ed-427f-94f2-88063ee7ef59 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:09.859317 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-19824ab5-b7ed-427f-94f2-88063ee7ef59 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:09.860095 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-19824ab5-b7ed-427f-94f2-88063ee7ef59 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:09.860593 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-19824ab5-b7ed-427f-94f2-88063ee7ef59 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:09.927526 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-19824ab5-b7ed-427f-94f2-88063ee7ef59 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:09.934980 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-19824ab5-b7ed-427f-94f2-88063ee7ef59 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1215 microversion: 2.1 time: 0.087112 Dec 15 13:07:09.935474 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 303/666] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:09 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1215 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:10.509403 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8665c5e3-96dd-4da8-853c-5417fa746c4e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:10.510117 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8665c5e3-96dd-4da8-853c-5417fa746c4e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:10.518103 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8665c5e3-96dd-4da8-853c-5417fa746c4e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:10.518888 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8665c5e3-96dd-4da8-853c-5417fa746c4e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:10.520040 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8665c5e3-96dd-4da8-853c-5417fa746c4e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:10.520583 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8665c5e3-96dd-4da8-853c-5417fa746c4e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:10.567159 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-6afabae5-3df8-4f1c-b6e3-b63eaf204c34 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:10.567921 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-6afabae5-3df8-4f1c-b6e3-b63eaf204c34 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:10.574369 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6afabae5-3df8-4f1c-b6e3-b63eaf204c34 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:10.574825 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6afabae5-3df8-4f1c-b6e3-b63eaf204c34 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:10.576175 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6afabae5-3df8-4f1c-b6e3-b63eaf204c34 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:10.576618 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6afabae5-3df8-4f1c-b6e3-b63eaf204c34 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:10.693635 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8665c5e3-96dd-4da8-853c-5417fa746c4e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:10.703452 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8665c5e3-96dd-4da8-853c-5417fa746c4e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:10.704729 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8665c5e3-96dd-4da8-853c-5417fa746c4e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:10.705969 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8665c5e3-96dd-4da8-853c-5417fa746c4e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.200270 Dec 15 13:07:10.706850 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 364/667] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:07:10 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:07:10.711117 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0042d605-466a-4947-b856-cc01408021b7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:10.711907 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0042d605-466a-4947-b856-cc01408021b7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:10.717944 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0042d605-466a-4947-b856-cc01408021b7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:10.718754 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0042d605-466a-4947-b856-cc01408021b7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:10.719728 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0042d605-466a-4947-b856-cc01408021b7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:10.720332 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0042d605-466a-4947-b856-cc01408021b7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:10.765188 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-6afabae5-3df8-4f1c-b6e3-b63eaf204c34 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:10.777710 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-6afabae5-3df8-4f1c-b6e3-b63eaf204c34 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1318 microversion: 2.1 time: 0.213989 Dec 15 13:07:10.779888 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 304/668] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:10 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:10.823248 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-5369b9d0-a49b-4ee8-b623-027a7dbfb70b tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:10.824335 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-5369b9d0-a49b-4ee8-b623-027a7dbfb70b tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:10.836252 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5369b9d0-a49b-4ee8-b623-027a7dbfb70b tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:10.837199 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5369b9d0-a49b-4ee8-b623-027a7dbfb70b tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:10.838810 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5369b9d0-a49b-4ee8-b623-027a7dbfb70b tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:10.840503 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5369b9d0-a49b-4ee8-b623-027a7dbfb70b tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:10.890621 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0042d605-466a-4947-b856-cc01408021b7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:10.924171 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-0042d605-466a-4947-b856-cc01408021b7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.214532 Dec 15 13:07:10.925250 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 365/669] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:10 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:10.961384 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-bb540129-4eff-4815-85e6-89316efe7d8a tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:10.962535 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-bb540129-4eff-4815-85e6-89316efe7d8a tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:10.973620 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bb540129-4eff-4815-85e6-89316efe7d8a tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:10.974836 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bb540129-4eff-4815-85e6-89316efe7d8a tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:10.976702 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bb540129-4eff-4815-85e6-89316efe7d8a tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:10.977618 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bb540129-4eff-4815-85e6-89316efe7d8a tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:11.081567 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-bb540129-4eff-4815-85e6-89316efe7d8a tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:11.090291 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-bb540129-4eff-4815-85e6-89316efe7d8a tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1215 microversion: 2.1 time: 0.138688 Dec 15 13:07:11.096888 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 366/670] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:10 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1215 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:11.265292 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-5369b9d0-a49b-4ee8-b623-027a7dbfb70b tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:11.303185 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-5369b9d0-a49b-4ee8-b623-027a7dbfb70b tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1504 microversion: 2.1 time: 0.485326 Dec 15 13:07:11.305740 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 305/671] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:10 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1504 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:11.738468 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8ff5bd29-3b81-4020-8f47-8c66907bc7c2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:11.739587 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8ff5bd29-3b81-4020-8f47-8c66907bc7c2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:11.750673 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8ff5bd29-3b81-4020-8f47-8c66907bc7c2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:11.751483 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8ff5bd29-3b81-4020-8f47-8c66907bc7c2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:11.752860 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8ff5bd29-3b81-4020-8f47-8c66907bc7c2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:11.753776 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8ff5bd29-3b81-4020-8f47-8c66907bc7c2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:11.801221 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-156aa6d3-f07e-4143-8ef6-8eaf0844e834 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:11.802089 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-156aa6d3-f07e-4143-8ef6-8eaf0844e834 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:11.810971 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-156aa6d3-f07e-4143-8ef6-8eaf0844e834 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:11.811804 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-156aa6d3-f07e-4143-8ef6-8eaf0844e834 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:11.812946 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-156aa6d3-f07e-4143-8ef6-8eaf0844e834 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:11.813778 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-156aa6d3-f07e-4143-8ef6-8eaf0844e834 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:11.975042 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8ff5bd29-3b81-4020-8f47-8c66907bc7c2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:11.980661 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-156aa6d3-f07e-4143-8ef6-8eaf0844e834 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:11.989821 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-156aa6d3-f07e-4143-8ef6-8eaf0844e834 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1508 microversion: 2.1 time: 0.192239 Dec 15 13:07:11.990435 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 306/672] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:11 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1508 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:11.998615 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8ff5bd29-3b81-4020-8f47-8c66907bc7c2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:11.998615 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8ff5bd29-3b81-4020-8f47-8c66907bc7c2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:11.999070 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8ff5bd29-3b81-4020-8f47-8c66907bc7c2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.267948 Dec 15 13:07:11.999786 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 367/673] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:07:11 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:07:12.015475 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-cdd27112-03ca-49a5-aa06-400047e78c80 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:12.017319 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-cdd27112-03ca-49a5-aa06-400047e78c80 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:12.024738 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cdd27112-03ca-49a5-aa06-400047e78c80 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:12.025194 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cdd27112-03ca-49a5-aa06-400047e78c80 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:12.025988 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cdd27112-03ca-49a5-aa06-400047e78c80 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:12.026456 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cdd27112-03ca-49a5-aa06-400047e78c80 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:12.117182 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c2346df8-2141-49f5-8aed-dcd377addba9 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:12.118248 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c2346df8-2141-49f5-8aed-dcd377addba9 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:12.130526 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c2346df8-2141-49f5-8aed-dcd377addba9 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:12.131281 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c2346df8-2141-49f5-8aed-dcd377addba9 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:12.136942 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c2346df8-2141-49f5-8aed-dcd377addba9 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:12.138424 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c2346df8-2141-49f5-8aed-dcd377addba9 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:12.248724 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-cdd27112-03ca-49a5-aa06-400047e78c80 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:12.256907 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-cdd27112-03ca-49a5-aa06-400047e78c80 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.253801 Dec 15 13:07:12.267836 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 307/674] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:11 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:12.286213 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c2346df8-2141-49f5-8aed-dcd377addba9 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:12.296496 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c2346df8-2141-49f5-8aed-dcd377addba9 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1279 microversion: 2.1 time: 0.182754 Dec 15 13:07:12.307791 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 368/675] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:12 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1279 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:12.323943 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-25d452c3-6c8f-458a-874e-3055496d9ccc tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:12.324733 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-25d452c3-6c8f-458a-874e-3055496d9ccc tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:12.332957 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-25d452c3-6c8f-458a-874e-3055496d9ccc tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:12.335519 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-25d452c3-6c8f-458a-874e-3055496d9ccc tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:12.336344 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-25d452c3-6c8f-458a-874e-3055496d9ccc tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:12.338966 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-25d452c3-6c8f-458a-874e-3055496d9ccc tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:12.559197 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-25d452c3-6c8f-458a-874e-3055496d9ccc tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:12.567600 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-25d452c3-6c8f-458a-874e-3055496d9ccc tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1504 microversion: 2.1 time: 0.247994 Dec 15 13:07:12.578302 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 308/676] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:12 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1504 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:13.017181 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1942827a-d788-47c4-99b3-b31cec5dccfa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:13.017804 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1942827a-d788-47c4-99b3-b31cec5dccfa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:13.024840 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1942827a-d788-47c4-99b3-b31cec5dccfa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:13.025296 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1942827a-d788-47c4-99b3-b31cec5dccfa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:13.026091 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1942827a-d788-47c4-99b3-b31cec5dccfa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:13.026582 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1942827a-d788-47c4-99b3-b31cec5dccfa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:13.236038 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1942827a-d788-47c4-99b3-b31cec5dccfa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:13.245973 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1942827a-d788-47c4-99b3-b31cec5dccfa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:13.247721 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1942827a-d788-47c4-99b3-b31cec5dccfa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:13.248876 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1942827a-d788-47c4-99b3-b31cec5dccfa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.235814 Dec 15 13:07:13.249626 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 369/677] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:07:13 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:07:13.274899 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-97b8fc5c-8103-4912-b2a8-75c0c78c392f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:13.275886 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-97b8fc5c-8103-4912-b2a8-75c0c78c392f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:13.283330 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-97b8fc5c-8103-4912-b2a8-75c0c78c392f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:13.283792 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-97b8fc5c-8103-4912-b2a8-75c0c78c392f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:13.284611 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-97b8fc5c-8103-4912-b2a8-75c0c78c392f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:13.285051 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-97b8fc5c-8103-4912-b2a8-75c0c78c392f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:13.314254 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e333a543-3d80-4fcb-a8b6-0748cacaff0b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:13.315293 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e333a543-3d80-4fcb-a8b6-0748cacaff0b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:13.332425 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e333a543-3d80-4fcb-a8b6-0748cacaff0b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:13.332868 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e333a543-3d80-4fcb-a8b6-0748cacaff0b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:13.333655 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e333a543-3d80-4fcb-a8b6-0748cacaff0b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:13.334083 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e333a543-3d80-4fcb-a8b6-0748cacaff0b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:13.487897 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-97b8fc5c-8103-4912-b2a8-75c0c78c392f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:13.496824 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-97b8fc5c-8103-4912-b2a8-75c0c78c392f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.225589 Dec 15 13:07:13.507104 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 309/678] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:13 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:13.523654 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-5300c706-4259-4b27-a86a-3e9df7b0587d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c68fe73-62fd-4233-8327-6d89cd2a3976"}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:07:13.524782 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-5300c706-4259-4b27-a86a-3e9df7b0587d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:13.531170 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5300c706-4259-4b27-a86a-3e9df7b0587d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:13.531623 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5300c706-4259-4b27-a86a-3e9df7b0587d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:13.532409 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5300c706-4259-4b27-a86a-3e9df7b0587d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:13.532843 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5300c706-4259-4b27-a86a-3e9df7b0587d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:13.580435 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e333a543-3d80-4fcb-a8b6-0748cacaff0b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:13.589612 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e333a543-3d80-4fcb-a8b6-0748cacaff0b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1319 microversion: 2.1 time: 0.278642 Dec 15 13:07:13.590302 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 370/679] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:13 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:13.595042 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-2e37011e-de5f-4230-9d18-ce7d91a0e9ee tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:13.595891 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-2e37011e-de5f-4230-9d18-ce7d91a0e9ee tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:13.607603 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2e37011e-de5f-4230-9d18-ce7d91a0e9ee tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:13.608602 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2e37011e-de5f-4230-9d18-ce7d91a0e9ee tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:13.609529 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2e37011e-de5f-4230-9d18-ce7d91a0e9ee tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:13.609989 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2e37011e-de5f-4230-9d18-ce7d91a0e9ee tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:13.847270 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-2e37011e-de5f-4230-9d18-ce7d91a0e9ee tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:13.855514 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-2e37011e-de5f-4230-9d18-ce7d91a0e9ee tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1504 microversion: 2.1 time: 0.263901 Dec 15 13:07:13.856598 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 371/680] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:13 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1504 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:13.896084 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-5300c706-4259-4b27-a86a-3e9df7b0587d tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "POST /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.375953 Dec 15 13:07:13.896991 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 310/681] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Dec 15 13:07:13 2021] POST /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960/os-volume_attachments => generated 194 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:07:14.024797 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-acbe14d6-232a-4987-894e-105964ed402d req-7a7ca522-00ce-4284-bb27-1ab9371f5c37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8be01f4-a176-41ba-b710-1a2fe19b85f5", "tag": "10b5cfb7-0ae1-469d-b8d2-adb0846fc020"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:07:14.026350 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:07:14.026350 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:07:14.038045 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-acbe14d6-232a-4987-894e-105964ed402d req-7a7ca522-00ce-4284-bb27-1ab9371f5c37 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:14.040921 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-acbe14d6-232a-4987-894e-105964ed402d req-7a7ca522-00ce-4284-bb27-1ab9371f5c37 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:14.065350 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-81ad2be5-f1b9-4a44-8ad0-c263a459c5d0 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2139704637", "imageRef": "67890983-693f-44ed-bdf3-22321abeab26", "flavorRef": "452"}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:07:14.069386 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-acbe14d6-232a-4987-894e-105964ed402d req-7a7ca522-00ce-4284-bb27-1ab9371f5c37 service nova] Creating event network-changed:10b5cfb7-0ae1-469d-b8d2-adb0846fc020 for instance d8be01f4-a176-41ba-b710-1a2fe19b85f5 on hv-cinder-81322 Dec 15 13:07:14.076234 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-acbe14d6-232a-4987-894e-105964ed402d req-7a7ca522-00ce-4284-bb27-1ab9371f5c37 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055968 Dec 15 13:07:14.079932 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 372/682] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:07:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:07:14.127508 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.network.neutron [None req-81ad2be5-f1b9-4a44-8ad0-c263a459c5d0 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] validate_networks() for None {{(pid=116097) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:07:14.269250 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b4865939-9266-4c17-91b4-d56653eab02f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:14.270133 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b4865939-9266-4c17-91b4-d56653eab02f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:14.276740 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b4865939-9266-4c17-91b4-d56653eab02f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:14.277373 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b4865939-9266-4c17-91b4-d56653eab02f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:14.279036 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b4865939-9266-4c17-91b4-d56653eab02f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:14.279631 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b4865939-9266-4c17-91b4-d56653eab02f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:14.526022 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b4865939-9266-4c17-91b4-d56653eab02f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:14.534887 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b4865939-9266-4c17-91b4-d56653eab02f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:14.536476 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b4865939-9266-4c17-91b4-d56653eab02f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:14.537710 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b4865939-9266-4c17-91b4-d56653eab02f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.272955 Dec 15 13:07:14.538367 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 373/683] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:07:14 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:07:14.543005 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9d66ad3c-53d0-4a26-a4f4-7cd2ecb3c1e7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:14.543850 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9d66ad3c-53d0-4a26-a4f4-7cd2ecb3c1e7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:14.550508 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9d66ad3c-53d0-4a26-a4f4-7cd2ecb3c1e7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:14.551277 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9d66ad3c-53d0-4a26-a4f4-7cd2ecb3c1e7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:14.552070 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9d66ad3c-53d0-4a26-a4f4-7cd2ecb3c1e7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:14.552502 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9d66ad3c-53d0-4a26-a4f4-7cd2ecb3c1e7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:14.729476 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-9d66ad3c-53d0-4a26-a4f4-7cd2ecb3c1e7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:14.737832 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9d66ad3c-53d0-4a26-a4f4-7cd2ecb3c1e7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.198118 Dec 15 13:07:14.748723 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 374/684] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:14 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:14.748723 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-85a9c7cc-192b-4a5b-a68b-0acdb2a2cb35 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:14.748723 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-85a9c7cc-192b-4a5b-a68b-0acdb2a2cb35 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:14.750883 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-85a9c7cc-192b-4a5b-a68b-0acdb2a2cb35 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:14.751345 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-85a9c7cc-192b-4a5b-a68b-0acdb2a2cb35 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:14.752113 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-85a9c7cc-192b-4a5b-a68b-0acdb2a2cb35 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:14.752540 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-85a9c7cc-192b-4a5b-a68b-0acdb2a2cb35 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:14.813925 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-81ad2be5-f1b9-4a44-8ad0-c263a459c5d0 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Flavor limits 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:07:14.814384 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-81ad2be5-f1b9-4a44-8ad0-c263a459c5d0 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Image limits 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:07:14.814850 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-81ad2be5-f1b9-4a44-8ad0-c263a459c5d0 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Flavor pref 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:07:14.815705 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-81ad2be5-f1b9-4a44-8ad0-c263a459c5d0 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Image pref 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:07:14.816185 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-81ad2be5-f1b9-4a44-8ad0-c263a459c5d0 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:07:14.826984 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-81ad2be5-f1b9-4a44-8ad0-c263a459c5d0 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:14.827484 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-81ad2be5-f1b9-4a44-8ad0-c263a459c5d0 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:14.828318 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-81ad2be5-f1b9-4a44-8ad0-c263a459c5d0 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:14.828758 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-81ad2be5-f1b9-4a44-8ad0-c263a459c5d0 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:14.853588 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-81ad2be5-f1b9-4a44-8ad0-c263a459c5d0 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Getting quotas for project 91d936046d064508ba41edf0024c46e3. Resources: {'instances', 'cores', 'ram'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:07:14.858045 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-81ad2be5-f1b9-4a44-8ad0-c263a459c5d0 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Getting quotas for user 4d477d0eafb8448296405640b334d715 and project 91d936046d064508ba41edf0024c46e3. Resources: {'instances', 'cores', 'ram'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:07:14.872251 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-81ad2be5-f1b9-4a44-8ad0-c263a459c5d0 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Going to run 1 instances... {{(pid=116097) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:07:14.874882 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-81ad2be5-f1b9-4a44-8ad0-c263a459c5d0 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] [instance: 68f4f473-3be6-4a7f-ae97-b125ff3a73fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67890983-693f-44ed-bdf3-22321abeab26',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:07:14.930539 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-81ad2be5-f1b9-4a44-8ad0-c263a459c5d0 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.868403 Dec 15 13:07:14.931771 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 311/685] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Dec 15 13:07:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:07:14.941958 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-11f1d210-65d8-43e7-a4e1-34a83b5eb4f2 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:14.942709 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-11f1d210-65d8-43e7-a4e1-34a83b5eb4f2 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:14.953623 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-11f1d210-65d8-43e7-a4e1-34a83b5eb4f2 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:14.954880 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-11f1d210-65d8-43e7-a4e1-34a83b5eb4f2 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:14.955847 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-11f1d210-65d8-43e7-a4e1-34a83b5eb4f2 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:14.956316 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-11f1d210-65d8-43e7-a4e1-34a83b5eb4f2 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:14.998998 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-85a9c7cc-192b-4a5b-a68b-0acdb2a2cb35 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:15.006809 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-85a9c7cc-192b-4a5b-a68b-0acdb2a2cb35 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1319 microversion: 2.1 time: 0.266877 Dec 15 13:07:15.018939 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 375/686] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:14 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:15.023848 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-358e0d18-b557-4ada-baa5-f4d5bfeb49ff tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:15.024678 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-358e0d18-b557-4ada-baa5-f4d5bfeb49ff tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] [instance: 68f4f473-3be6-4a7f-ae97-b125ff3a73fc] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:15.092146 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-358e0d18-b557-4ada-baa5-f4d5bfeb49ff tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d477d0eafb8448296405640b334d715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d936046d064508ba41edf0024c46e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:15.101917 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-358e0d18-b557-4ada-baa5-f4d5bfeb49ff tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] 10.222.0.57 "GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc" status: 200 len: 1215 microversion: 2.1 time: 0.079352 Dec 15 13:07:15.102556 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 376/687] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:15 2021] GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc => generated 1215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:15.122856 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-199adeaf-3d89-40ac-a9ef-dc40c4ab1e20 req-01c90fc9-a691-406c-91a5-815ce7bca786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "902f62f8-3d70-4b3a-90a6-c924126e5300", "name": "network-vif-deleted", "tag": "c3e32283-04ca-4ceb-90b7-6e2249b3c261"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:07:15.126474 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:07:15.126474 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:07:15.138525 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-199adeaf-3d89-40ac-a9ef-dc40c4ab1e20 req-01c90fc9-a691-406c-91a5-815ce7bca786 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:15.139003 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-199adeaf-3d89-40ac-a9ef-dc40c4ab1e20 req-01c90fc9-a691-406c-91a5-815ce7bca786 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:15.151773 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-199adeaf-3d89-40ac-a9ef-dc40c4ab1e20 req-01c90fc9-a691-406c-91a5-815ce7bca786 service nova] Creating event network-vif-deleted:c3e32283-04ca-4ceb-90b7-6e2249b3c261 for instance 902f62f8-3d70-4b3a-90a6-c924126e5300 on hv-cinder-81322 Dec 15 13:07:15.151943 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-11f1d210-65d8-43e7-a4e1-34a83b5eb4f2 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5db27c491ee4002854039f9e53f52af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46bbc0bed7d4240b988cedfca33d196', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:15.157456 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-199adeaf-3d89-40ac-a9ef-dc40c4ab1e20 req-01c90fc9-a691-406c-91a5-815ce7bca786 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044021 Dec 15 13:07:15.159730 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 377/688] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:07:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:07:15.161696 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-11f1d210-65d8-43e7-a4e1-34a83b5eb4f2 tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 200 len: 1462 microversion: 2.1 time: 0.226179 Dec 15 13:07:15.162291 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 312/689] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:14 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 1462 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:15.557273 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b2c423a8-86ce-4d2b-a574-c49e4e16f312 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:15.558041 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b2c423a8-86ce-4d2b-a574-c49e4e16f312 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:15.565149 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b2c423a8-86ce-4d2b-a574-c49e4e16f312 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:15.565599 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b2c423a8-86ce-4d2b-a574-c49e4e16f312 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:15.566396 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b2c423a8-86ce-4d2b-a574-c49e4e16f312 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:15.566863 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b2c423a8-86ce-4d2b-a574-c49e4e16f312 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:15.701781 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b2c423a8-86ce-4d2b-a574-c49e4e16f312 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:15.711223 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b2c423a8-86ce-4d2b-a574-c49e4e16f312 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:15.713129 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b2c423a8-86ce-4d2b-a574-c49e4e16f312 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:15.714519 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b2c423a8-86ce-4d2b-a574-c49e4e16f312 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.161777 Dec 15 13:07:15.715221 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 378/690] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:07:15 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:07:15.755470 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-d79f5eb0-9897-431d-be13-f2a7a9d94e19 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:15.756237 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-d79f5eb0-9897-431d-be13-f2a7a9d94e19 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:15.763364 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d79f5eb0-9897-431d-be13-f2a7a9d94e19 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:15.763903 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d79f5eb0-9897-431d-be13-f2a7a9d94e19 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:15.764808 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d79f5eb0-9897-431d-be13-f2a7a9d94e19 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:15.765281 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d79f5eb0-9897-431d-be13-f2a7a9d94e19 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:15.918487 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-d79f5eb0-9897-431d-be13-f2a7a9d94e19 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:15.925660 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-d79f5eb0-9897-431d-be13-f2a7a9d94e19 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1500 microversion: 2.1 time: 0.174215 Dec 15 13:07:15.926751 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 313/691] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:15 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1500 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:15.945000 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f5beb4a6-29e5-4d8e-9245-8103fac5544d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed1f0bb2-f8bd-4a0e-9362-92a4d0dd6be0"}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:07:15.946516 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f5beb4a6-29e5-4d8e-9245-8103fac5544d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:15.953788 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f5beb4a6-29e5-4d8e-9245-8103fac5544d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:15.954355 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f5beb4a6-29e5-4d8e-9245-8103fac5544d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:15.955075 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f5beb4a6-29e5-4d8e-9245-8103fac5544d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:15.955541 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f5beb4a6-29e5-4d8e-9245-8103fac5544d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:15.980071 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-f5beb4a6-29e5-4d8e-9245-8103fac5544d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] HTTP exception thrown: Cannot 'attach_volume' instance 46358568-c4cc-4dd2-81e7-c724c57ee533 while it is in vm_state rescued Dec 15 13:07:15.980661 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f5beb4a6-29e5-4d8e-9245-8103fac5544d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Returning 409 to user: Cannot 'attach_volume' instance 46358568-c4cc-4dd2-81e7-c724c57ee533 while it is in vm_state rescued {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:07:15.981536 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f5beb4a6-29e5-4d8e-9245-8103fac5544d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "POST /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041239 Dec 15 13:07:15.982111 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 379/692] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Dec 15 13:07:15 2021] POST /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Dec 15 13:07:15.992166 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-8298fd95-ca79-4c4a-84bd-dba17473a4a7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:07:15.992696 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-8298fd95-ca79-4c4a-84bd-dba17473a4a7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:15.999101 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8298fd95-ca79-4c4a-84bd-dba17473a4a7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:15.999548 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8298fd95-ca79-4c4a-84bd-dba17473a4a7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:16.000315 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8298fd95-ca79-4c4a-84bd-dba17473a4a7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:16.000748 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8298fd95-ca79-4c4a-84bd-dba17473a4a7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:16.035212 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7a250f5d-1132-4132-b14d-a05f86044f30 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:16.035939 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7a250f5d-1132-4132-b14d-a05f86044f30 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:16.043167 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7a250f5d-1132-4132-b14d-a05f86044f30 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:16.043739 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7a250f5d-1132-4132-b14d-a05f86044f30 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:16.044654 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7a250f5d-1132-4132-b14d-a05f86044f30 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:16.045129 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7a250f5d-1132-4132-b14d-a05f86044f30 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:16.071136 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-8298fd95-ca79-4c4a-84bd-dba17473a4a7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "POST /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/action" status: 202 len: 0 microversion: 2.1 time: 0.082493 Dec 15 13:07:16.072180 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 314/693] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:07:15 2021] POST /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:07:16.088903 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-7eebbdd5-27d2-4141-955c-7d810159c8f0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:16.089496 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-7eebbdd5-27d2-4141-955c-7d810159c8f0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:16.100268 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7eebbdd5-27d2-4141-955c-7d810159c8f0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:16.101205 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7eebbdd5-27d2-4141-955c-7d810159c8f0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:16.102011 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7eebbdd5-27d2-4141-955c-7d810159c8f0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:16.102472 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7eebbdd5-27d2-4141-955c-7d810159c8f0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:16.243544 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-7eebbdd5-27d2-4141-955c-7d810159c8f0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:16.251698 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-7eebbdd5-27d2-4141-955c-7d810159c8f0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1508 microversion: 2.1 time: 0.171596 Dec 15 13:07:16.252287 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 315/694] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:16 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:16.261825 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-d82a5410-fe56-43ba-83c7-9a6fa7b2e850 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:16.261825 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-d82a5410-fe56-43ba-83c7-9a6fa7b2e850 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] [instance: 68f4f473-3be6-4a7f-ae97-b125ff3a73fc] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:16.263854 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d82a5410-fe56-43ba-83c7-9a6fa7b2e850 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:16.264300 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d82a5410-fe56-43ba-83c7-9a6fa7b2e850 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:16.265101 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d82a5410-fe56-43ba-83c7-9a6fa7b2e850 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:16.265546 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d82a5410-fe56-43ba-83c7-9a6fa7b2e850 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:16.301960 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-7a250f5d-1132-4132-b14d-a05f86044f30 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:16.310664 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7a250f5d-1132-4132-b14d-a05f86044f30 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1319 microversion: 2.1 time: 0.279328 Dec 15 13:07:16.311517 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 380/695] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:16 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:16.316198 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e96f1a46-e4d9-47f0-a862-9ab46ea7105c tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:16.316825 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e96f1a46-e4d9-47f0-a862-9ab46ea7105c tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] [instance: 902f62f8-3d70-4b3a-90a6-c924126e5300] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:16.322936 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e96f1a46-e4d9-47f0-a862-9ab46ea7105c tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:16.323350 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e96f1a46-e4d9-47f0-a862-9ab46ea7105c tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:16.324292 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e96f1a46-e4d9-47f0-a862-9ab46ea7105c tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:16.324971 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e96f1a46-e4d9-47f0-a862-9ab46ea7105c tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:16.331584 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-d82a5410-fe56-43ba-83c7-9a6fa7b2e850 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d477d0eafb8448296405640b334d715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d936046d064508ba41edf0024c46e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:16.339516 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-d82a5410-fe56-43ba-83c7-9a6fa7b2e850 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] 10.222.0.57 "GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc" status: 200 len: 1267 microversion: 2.1 time: 0.086080 Dec 15 13:07:16.340326 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 316/696] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:16 2021] GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:16.342611 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-e96f1a46-e4d9-47f0-a862-9ab46ea7105c tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] HTTP exception thrown: Instance 902f62f8-3d70-4b3a-90a6-c924126e5300 could not be found. Dec 15 13:07:16.343349 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e96f1a46-e4d9-47f0-a862-9ab46ea7105c tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] Returning 404 to user: Instance 902f62f8-3d70-4b3a-90a6-c924126e5300 could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:07:16.344318 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e96f1a46-e4d9-47f0-a862-9ab46ea7105c tempest-VolumesActionsTest-1067697101 tempest-VolumesActionsTest-1067697101-project] 10.222.0.57 "GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300" status: 404 len: 111 microversion: 2.1 time: 0.031899 Dec 15 13:07:16.345259 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 381/697] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:16 2021] GET /compute/v2.1/servers/902f62f8-3d70-4b3a-90a6-c924126e5300 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:07:16.737024 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-de574227-c6ab-48a5-908d-bb70c0132e9b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:16.737799 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-de574227-c6ab-48a5-908d-bb70c0132e9b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:16.744575 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-de574227-c6ab-48a5-908d-bb70c0132e9b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:16.756367 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-de574227-c6ab-48a5-908d-bb70c0132e9b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:16.757475 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-de574227-c6ab-48a5-908d-bb70c0132e9b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:16.758007 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-de574227-c6ab-48a5-908d-bb70c0132e9b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:16.945180 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-de574227-c6ab-48a5-908d-bb70c0132e9b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:16.959062 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-de574227-c6ab-48a5-908d-bb70c0132e9b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:16.961503 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-de574227-c6ab-48a5-908d-bb70c0132e9b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:16.964024 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-de574227-c6ab-48a5-908d-bb70c0132e9b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.230612 Dec 15 13:07:16.967647 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 317/698] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:07:16 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:07:17.270778 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-3581fa40-2bf3-4838-8a10-45124ed5f362 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:17.271382 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-3581fa40-2bf3-4838-8a10-45124ed5f362 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:17.280780 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3581fa40-2bf3-4838-8a10-45124ed5f362 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:17.282042 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3581fa40-2bf3-4838-8a10-45124ed5f362 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:17.283309 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3581fa40-2bf3-4838-8a10-45124ed5f362 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:17.283751 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3581fa40-2bf3-4838-8a10-45124ed5f362 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:17.327712 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-6e8b9b5b-82d0-4ce3-989e-1aac23b2e0b0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:17.328328 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-6e8b9b5b-82d0-4ce3-989e-1aac23b2e0b0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:17.335283 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6e8b9b5b-82d0-4ce3-989e-1aac23b2e0b0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:17.335805 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6e8b9b5b-82d0-4ce3-989e-1aac23b2e0b0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:17.336772 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6e8b9b5b-82d0-4ce3-989e-1aac23b2e0b0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:17.337369 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6e8b9b5b-82d0-4ce3-989e-1aac23b2e0b0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:17.420376 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-3581fa40-2bf3-4838-8a10-45124ed5f362 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:17.430090 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-3581fa40-2bf3-4838-8a10-45124ed5f362 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1508 microversion: 2.1 time: 0.163119 Dec 15 13:07:17.430858 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 382/699] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:17 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:17.436190 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d2f0e80e-a86c-421b-a2b5-d9df41829131 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:17.436936 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d2f0e80e-a86c-421b-a2b5-d9df41829131 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] [instance: 68f4f473-3be6-4a7f-ae97-b125ff3a73fc] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:17.443936 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d2f0e80e-a86c-421b-a2b5-d9df41829131 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:17.444424 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d2f0e80e-a86c-421b-a2b5-d9df41829131 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:17.445983 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d2f0e80e-a86c-421b-a2b5-d9df41829131 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:17.446649 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d2f0e80e-a86c-421b-a2b5-d9df41829131 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:17.558278 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-6e8b9b5b-82d0-4ce3-989e-1aac23b2e0b0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:17.567411 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-6e8b9b5b-82d0-4ce3-989e-1aac23b2e0b0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1319 microversion: 2.1 time: 0.244029 Dec 15 13:07:17.568000 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 318/700] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:17 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:17.606530 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d2f0e80e-a86c-421b-a2b5-d9df41829131 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d477d0eafb8448296405640b334d715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d936046d064508ba41edf0024c46e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:17.613785 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d2f0e80e-a86c-421b-a2b5-d9df41829131 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] 10.222.0.57 "GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc" status: 200 len: 1315 microversion: 2.1 time: 0.181832 Dec 15 13:07:17.614490 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 383/701] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:17 2021] GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:17.984203 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-ec223c8f-7600-49a6-9461-b0bc9b53c46e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:17.984804 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-ec223c8f-7600-49a6-9461-b0bc9b53c46e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:17.991957 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ec223c8f-7600-49a6-9461-b0bc9b53c46e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:17.992734 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ec223c8f-7600-49a6-9461-b0bc9b53c46e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:17.994179 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ec223c8f-7600-49a6-9461-b0bc9b53c46e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:17.994916 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ec223c8f-7600-49a6-9461-b0bc9b53c46e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:18.133833 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-ec223c8f-7600-49a6-9461-b0bc9b53c46e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:18.142217 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-ec223c8f-7600-49a6-9461-b0bc9b53c46e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:18.143716 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-ec223c8f-7600-49a6-9461-b0bc9b53c46e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:18.144853 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-ec223c8f-7600-49a6-9461-b0bc9b53c46e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.164946 Dec 15 13:07:18.145408 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 319/702] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:07:17 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:07:18.448774 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6f0452ca-058a-4d19-b179-6afe77c87fdc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:18.449570 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-6f0452ca-058a-4d19-b179-6afe77c87fdc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:18.457851 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6f0452ca-058a-4d19-b179-6afe77c87fdc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:18.458454 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6f0452ca-058a-4d19-b179-6afe77c87fdc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:18.459397 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6f0452ca-058a-4d19-b179-6afe77c87fdc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:18.459938 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6f0452ca-058a-4d19-b179-6afe77c87fdc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:18.586881 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-254bfe08-62d8-498b-be89-fa370c5d1b95 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:18.587489 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-254bfe08-62d8-498b-be89-fa370c5d1b95 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:18.588963 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-6f0452ca-058a-4d19-b179-6afe77c87fdc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:18.594312 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-254bfe08-62d8-498b-be89-fa370c5d1b95 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:18.594760 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-254bfe08-62d8-498b-be89-fa370c5d1b95 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:18.595535 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-254bfe08-62d8-498b-be89-fa370c5d1b95 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:18.595966 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-254bfe08-62d8-498b-be89-fa370c5d1b95 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:18.596829 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6f0452ca-058a-4d19-b179-6afe77c87fdc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1508 microversion: 2.1 time: 0.152663 Dec 15 13:07:18.597395 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 384/703] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:18 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:18.631107 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d4c1b2ae-e225-46bb-9774-5aac55c77c4c tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:18.631719 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d4c1b2ae-e225-46bb-9774-5aac55c77c4c tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] [instance: 68f4f473-3be6-4a7f-ae97-b125ff3a73fc] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:18.638057 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d4c1b2ae-e225-46bb-9774-5aac55c77c4c tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:18.638522 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d4c1b2ae-e225-46bb-9774-5aac55c77c4c tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:18.639290 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d4c1b2ae-e225-46bb-9774-5aac55c77c4c tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:18.639716 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d4c1b2ae-e225-46bb-9774-5aac55c77c4c tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:18.724896 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-254bfe08-62d8-498b-be89-fa370c5d1b95 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:18.732968 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-254bfe08-62d8-498b-be89-fa370c5d1b95 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1319 microversion: 2.1 time: 0.149685 Dec 15 13:07:18.733680 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 320/704] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:18 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:18.775261 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d4c1b2ae-e225-46bb-9774-5aac55c77c4c tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d477d0eafb8448296405640b334d715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d936046d064508ba41edf0024c46e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:18.784085 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d4c1b2ae-e225-46bb-9774-5aac55c77c4c tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] 10.222.0.57 "GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc" status: 200 len: 1315 microversion: 2.1 time: 0.156317 Dec 15 13:07:18.784687 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 385/705] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:18 2021] GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:19.162913 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-f2c1c1cd-7548-4b50-b4e3-53d03ea85ce0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:19.163513 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-f2c1c1cd-7548-4b50-b4e3-53d03ea85ce0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:19.169880 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f2c1c1cd-7548-4b50-b4e3-53d03ea85ce0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:19.170351 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f2c1c1cd-7548-4b50-b4e3-53d03ea85ce0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:19.171119 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f2c1c1cd-7548-4b50-b4e3-53d03ea85ce0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:19.171545 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f2c1c1cd-7548-4b50-b4e3-53d03ea85ce0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:19.308840 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-f2c1c1cd-7548-4b50-b4e3-53d03ea85ce0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:19.317545 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-f2c1c1cd-7548-4b50-b4e3-53d03ea85ce0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:19.319082 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-f2c1c1cd-7548-4b50-b4e3-53d03ea85ce0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:19.320210 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-f2c1c1cd-7548-4b50-b4e3-53d03ea85ce0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.160965 Dec 15 13:07:19.320761 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 321/706] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:07:19 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:07:19.612949 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-431095e1-2ac3-4e0d-835c-c860942aee4d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:19.613467 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-431095e1-2ac3-4e0d-835c-c860942aee4d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:19.619687 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-431095e1-2ac3-4e0d-835c-c860942aee4d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:19.620124 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-431095e1-2ac3-4e0d-835c-c860942aee4d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:19.620889 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-431095e1-2ac3-4e0d-835c-c860942aee4d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:19.621318 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-431095e1-2ac3-4e0d-835c-c860942aee4d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:19.749704 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-ffabab24-0bfb-4722-9a57-25a3a636263b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:19.750508 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-ffabab24-0bfb-4722-9a57-25a3a636263b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:19.751160 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-431095e1-2ac3-4e0d-835c-c860942aee4d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:19.757307 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ffabab24-0bfb-4722-9a57-25a3a636263b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:19.757892 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ffabab24-0bfb-4722-9a57-25a3a636263b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:19.758832 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ffabab24-0bfb-4722-9a57-25a3a636263b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:19.758958 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-431095e1-2ac3-4e0d-835c-c860942aee4d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1508 microversion: 2.1 time: 0.149707 Dec 15 13:07:19.759761 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ffabab24-0bfb-4722-9a57-25a3a636263b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:19.759881 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 386/707] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:19 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:19.800769 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-014812ef-62b2-454a-bbf8-acb100b8c04e tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:19.801379 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-014812ef-62b2-454a-bbf8-acb100b8c04e tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] [instance: 68f4f473-3be6-4a7f-ae97-b125ff3a73fc] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:19.807555 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-014812ef-62b2-454a-bbf8-acb100b8c04e tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:19.808001 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-014812ef-62b2-454a-bbf8-acb100b8c04e tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:19.808804 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-014812ef-62b2-454a-bbf8-acb100b8c04e tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:19.809237 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-014812ef-62b2-454a-bbf8-acb100b8c04e tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:19.911806 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-ffabab24-0bfb-4722-9a57-25a3a636263b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:19.920009 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-ffabab24-0bfb-4722-9a57-25a3a636263b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1319 microversion: 2.1 time: 0.174078 Dec 15 13:07:19.930326 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 322/708] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:19 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:19.964467 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-014812ef-62b2-454a-bbf8-acb100b8c04e tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d477d0eafb8448296405640b334d715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d936046d064508ba41edf0024c46e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:19.972587 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-014812ef-62b2-454a-bbf8-acb100b8c04e tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] 10.222.0.57 "GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc" status: 200 len: 1315 microversion: 2.1 time: 0.175460 Dec 15 13:07:19.973235 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 387/709] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:19 2021] GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:20.338335 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-8abf67e3-6fe4-4386-b9ec-c993e53892c3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:20.338934 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-8abf67e3-6fe4-4386-b9ec-c993e53892c3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:20.344992 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8abf67e3-6fe4-4386-b9ec-c993e53892c3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:20.345612 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8abf67e3-6fe4-4386-b9ec-c993e53892c3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:20.346405 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8abf67e3-6fe4-4386-b9ec-c993e53892c3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:20.346834 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8abf67e3-6fe4-4386-b9ec-c993e53892c3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:20.470759 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-8abf67e3-6fe4-4386-b9ec-c993e53892c3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:20.478739 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-8abf67e3-6fe4-4386-b9ec-c993e53892c3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:20.480215 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-8abf67e3-6fe4-4386-b9ec-c993e53892c3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:20.481559 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-8abf67e3-6fe4-4386-b9ec-c993e53892c3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.146966 Dec 15 13:07:20.482108 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 323/710] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:07:20 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:07:20.775370 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8f8439ad-6c28-4ca4-a3c2-fb635b88c568 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:20.775954 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8f8439ad-6c28-4ca4-a3c2-fb635b88c568 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:20.782174 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8f8439ad-6c28-4ca4-a3c2-fb635b88c568 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:20.782632 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8f8439ad-6c28-4ca4-a3c2-fb635b88c568 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:20.783392 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8f8439ad-6c28-4ca4-a3c2-fb635b88c568 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:20.783823 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8f8439ad-6c28-4ca4-a3c2-fb635b88c568 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:20.912865 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8f8439ad-6c28-4ca4-a3c2-fb635b88c568 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:20.920595 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8f8439ad-6c28-4ca4-a3c2-fb635b88c568 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1508 microversion: 2.1 time: 0.148849 Dec 15 13:07:20.921161 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 388/711] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:20 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:20.936977 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-09b87331-bde8-4b30-890b-65b436deeb79 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:20.937589 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-09b87331-bde8-4b30-890b-65b436deeb79 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:20.943784 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-09b87331-bde8-4b30-890b-65b436deeb79 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:20.944231 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-09b87331-bde8-4b30-890b-65b436deeb79 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:20.945044 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-09b87331-bde8-4b30-890b-65b436deeb79 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:20.945481 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-09b87331-bde8-4b30-890b-65b436deeb79 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:20.988340 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-db93bb2c-6cdc-4ddc-b51e-3b832d7e61c7 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:20.988941 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-db93bb2c-6cdc-4ddc-b51e-3b832d7e61c7 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] [instance: 68f4f473-3be6-4a7f-ae97-b125ff3a73fc] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:20.994938 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-db93bb2c-6cdc-4ddc-b51e-3b832d7e61c7 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:20.995367 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-db93bb2c-6cdc-4ddc-b51e-3b832d7e61c7 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:20.996161 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-db93bb2c-6cdc-4ddc-b51e-3b832d7e61c7 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:20.997195 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-db93bb2c-6cdc-4ddc-b51e-3b832d7e61c7 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:21.125306 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-db93bb2c-6cdc-4ddc-b51e-3b832d7e61c7 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d477d0eafb8448296405640b334d715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d936046d064508ba41edf0024c46e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:21.133000 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-db93bb2c-6cdc-4ddc-b51e-3b832d7e61c7 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] 10.222.0.57 "GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc" status: 200 len: 1315 microversion: 2.1 time: 0.148194 Dec 15 13:07:21.133569 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 389/712] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:20 2021] GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:21.165195 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-09b87331-bde8-4b30-890b-65b436deeb79 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:21.172948 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-09b87331-bde8-4b30-890b-65b436deeb79 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1319 microversion: 2.1 time: 0.240093 Dec 15 13:07:21.173516 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 324/713] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:20 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:21.491092 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-fa3f9929-5970-42ad-8e25-44f242c8f9bb req-d68d9e2d-71dc-4e0c-a7fe-4009fbddc137 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68f4f473-3be6-4a7f-ae97-b125ff3a73fc", "tag": "58ae3c4f-f2b1-4ff8-b5b6-e2fb549417d3"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:07:21.493129 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:07:21.493129 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:07:21.500070 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-71ad189a-16d6-4a0a-8c87-62ab72d624b8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:21.501362 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-71ad189a-16d6-4a0a-8c87-62ab72d624b8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:21.505344 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-fa3f9929-5970-42ad-8e25-44f242c8f9bb req-d68d9e2d-71dc-4e0c-a7fe-4009fbddc137 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:21.505898 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-fa3f9929-5970-42ad-8e25-44f242c8f9bb req-d68d9e2d-71dc-4e0c-a7fe-4009fbddc137 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:21.510088 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-71ad189a-16d6-4a0a-8c87-62ab72d624b8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:21.513943 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-71ad189a-16d6-4a0a-8c87-62ab72d624b8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:21.515223 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-71ad189a-16d6-4a0a-8c87-62ab72d624b8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:21.515681 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-71ad189a-16d6-4a0a-8c87-62ab72d624b8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:21.529669 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-fa3f9929-5970-42ad-8e25-44f242c8f9bb req-d68d9e2d-71dc-4e0c-a7fe-4009fbddc137 service nova] Creating event network-changed:58ae3c4f-f2b1-4ff8-b5b6-e2fb549417d3 for instance 68f4f473-3be6-4a7f-ae97-b125ff3a73fc on hv-cinder-81322 Dec 15 13:07:21.537139 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-fa3f9929-5970-42ad-8e25-44f242c8f9bb req-d68d9e2d-71dc-4e0c-a7fe-4009fbddc137 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049564 Dec 15 13:07:21.538352 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 390/714] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:07:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:07:21.773389 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-71ad189a-16d6-4a0a-8c87-62ab72d624b8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:21.781672 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-71ad189a-16d6-4a0a-8c87-62ab72d624b8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:21.783289 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-71ad189a-16d6-4a0a-8c87-62ab72d624b8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:21.784508 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-71ad189a-16d6-4a0a-8c87-62ab72d624b8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.288624 Dec 15 13:07:21.785105 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 325/715] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:07:21 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:07:21.938263 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-3822133b-ea1e-479e-af78-f4a1f6b8733b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:21.938950 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-3822133b-ea1e-479e-af78-f4a1f6b8733b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:21.944855 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3822133b-ea1e-479e-af78-f4a1f6b8733b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:21.945297 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3822133b-ea1e-479e-af78-f4a1f6b8733b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:21.946059 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3822133b-ea1e-479e-af78-f4a1f6b8733b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:21.946518 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3822133b-ea1e-479e-af78-f4a1f6b8733b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:22.083173 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-3822133b-ea1e-479e-af78-f4a1f6b8733b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:22.091799 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-3822133b-ea1e-479e-af78-f4a1f6b8733b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1508 microversion: 2.1 time: 0.157945 Dec 15 13:07:22.092371 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 391/716] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:21 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:22.150621 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-00771129-e4fc-4553-9ff7-1a2f10dd24a5 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:22.151320 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-00771129-e4fc-4553-9ff7-1a2f10dd24a5 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] [instance: 68f4f473-3be6-4a7f-ae97-b125ff3a73fc] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:22.158013 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-00771129-e4fc-4553-9ff7-1a2f10dd24a5 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:22.158489 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-00771129-e4fc-4553-9ff7-1a2f10dd24a5 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:22.159263 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-00771129-e4fc-4553-9ff7-1a2f10dd24a5 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:22.159693 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-00771129-e4fc-4553-9ff7-1a2f10dd24a5 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:22.189711 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-be081f7c-3f7d-458a-99a2-271546f78dc6 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:22.190278 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-be081f7c-3f7d-458a-99a2-271546f78dc6 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:22.197041 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be081f7c-3f7d-458a-99a2-271546f78dc6 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:22.197687 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be081f7c-3f7d-458a-99a2-271546f78dc6 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:22.198507 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be081f7c-3f7d-458a-99a2-271546f78dc6 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:22.198946 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be081f7c-3f7d-458a-99a2-271546f78dc6 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:22.357992 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-be081f7c-3f7d-458a-99a2-271546f78dc6 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:22.370290 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-be081f7c-3f7d-458a-99a2-271546f78dc6 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1319 microversion: 2.1 time: 0.184067 Dec 15 13:07:22.370880 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 392/717] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:22 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:22.438828 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-00771129-e4fc-4553-9ff7-1a2f10dd24a5 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d477d0eafb8448296405640b334d715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d936046d064508ba41edf0024c46e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:22.447243 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-00771129-e4fc-4553-9ff7-1a2f10dd24a5 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] 10.222.0.57 "GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc" status: 200 len: 1315 microversion: 2.1 time: 0.300332 Dec 15 13:07:22.456472 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 326/718] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:22 2021] GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:22.613058 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4ee428d6-8328-409f-8c1a-30e511271e27 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:22.613915 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4ee428d6-8328-409f-8c1a-30e511271e27 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:22.621786 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4ee428d6-8328-409f-8c1a-30e511271e27 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:22.622502 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4ee428d6-8328-409f-8c1a-30e511271e27 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:22.623481 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4ee428d6-8328-409f-8c1a-30e511271e27 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:22.624093 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4ee428d6-8328-409f-8c1a-30e511271e27 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:22.706725 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.objects.instance [None req-4ee428d6-8328-409f-8c1a-30e511271e27 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lazy-loading 'services' on Instance uuid 538de0dc-a820-43f0-8b8f-0966f219e960 {{(pid=116098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:07:22.775111 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4ee428d6-8328-409f-8c1a-30e511271e27 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "DELETE /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960/os-volume_attachments/1c68fe73-62fd-4233-8327-6d89cd2a3976" status: 202 len: 0 microversion: 2.1 time: 0.165522 Dec 15 13:07:22.775880 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 393/719] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Dec 15 13:07:22 2021] DELETE /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960/os-volume_attachments/1c68fe73-62fd-4233-8327-6d89cd2a3976 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:07:22.784544 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-d3b44243-22a0-4beb-82ea-a1473c354628 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:22.786105 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-d3b44243-22a0-4beb-82ea-a1473c354628 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:22.792797 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d3b44243-22a0-4beb-82ea-a1473c354628 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:22.793289 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d3b44243-22a0-4beb-82ea-a1473c354628 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:22.794212 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d3b44243-22a0-4beb-82ea-a1473c354628 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:22.794796 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d3b44243-22a0-4beb-82ea-a1473c354628 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:22.803052 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-fbcabbb4-3b2c-4f88-9944-e8f61402d086 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:22.803761 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-fbcabbb4-3b2c-4f88-9944-e8f61402d086 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:22.810456 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fbcabbb4-3b2c-4f88-9944-e8f61402d086 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:22.810910 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fbcabbb4-3b2c-4f88-9944-e8f61402d086 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:22.811713 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fbcabbb4-3b2c-4f88-9944-e8f61402d086 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:22.812136 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fbcabbb4-3b2c-4f88-9944-e8f61402d086 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:22.843415 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-d3b44243-22a0-4beb-82ea-a1473c354628 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063007 Dec 15 13:07:22.847549 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 327/720] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:07:22 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:07:22.975078 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-fbcabbb4-3b2c-4f88-9944-e8f61402d086 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:22.985515 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-fbcabbb4-3b2c-4f88-9944-e8f61402d086 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:22.987443 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-fbcabbb4-3b2c-4f88-9944-e8f61402d086 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:22.988727 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-fbcabbb4-3b2c-4f88-9944-e8f61402d086 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.189829 Dec 15 13:07:22.989513 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 394/721] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:07:22 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:07:23.109079 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-5f068a9f-7f07-4fae-a768-df3168d69520 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:23.109716 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-5f068a9f-7f07-4fae-a768-df3168d69520 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:23.115560 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5f068a9f-7f07-4fae-a768-df3168d69520 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:23.116008 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5f068a9f-7f07-4fae-a768-df3168d69520 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:23.117020 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5f068a9f-7f07-4fae-a768-df3168d69520 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:23.117459 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5f068a9f-7f07-4fae-a768-df3168d69520 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:23.254596 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-5f068a9f-7f07-4fae-a768-df3168d69520 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:23.262621 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-5f068a9f-7f07-4fae-a768-df3168d69520 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1508 microversion: 2.1 time: 0.157207 Dec 15 13:07:23.265411 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 328/722] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:23 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:23.387584 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-115d4c59-9982-4d00-a694-68e6e7de1936 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:23.388181 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-115d4c59-9982-4d00-a694-68e6e7de1936 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:23.394539 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-115d4c59-9982-4d00-a694-68e6e7de1936 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:23.394911 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-115d4c59-9982-4d00-a694-68e6e7de1936 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:23.395667 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-115d4c59-9982-4d00-a694-68e6e7de1936 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:23.396114 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-115d4c59-9982-4d00-a694-68e6e7de1936 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:23.464667 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-72aa6a67-99ea-48b6-b5c3-e2b15035d60d tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:23.465464 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-72aa6a67-99ea-48b6-b5c3-e2b15035d60d tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] [instance: 68f4f473-3be6-4a7f-ae97-b125ff3a73fc] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:23.471895 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-72aa6a67-99ea-48b6-b5c3-e2b15035d60d tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:23.472372 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-72aa6a67-99ea-48b6-b5c3-e2b15035d60d tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:23.473144 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-72aa6a67-99ea-48b6-b5c3-e2b15035d60d tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:23.473575 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-72aa6a67-99ea-48b6-b5c3-e2b15035d60d tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:23.582890 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-115d4c59-9982-4d00-a694-68e6e7de1936 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:23.590398 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-115d4c59-9982-4d00-a694-68e6e7de1936 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1319 microversion: 2.1 time: 0.206880 Dec 15 13:07:23.590971 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 395/723] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:23 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:23.634397 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-72aa6a67-99ea-48b6-b5c3-e2b15035d60d tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d477d0eafb8448296405640b334d715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d936046d064508ba41edf0024c46e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:23.642870 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-72aa6a67-99ea-48b6-b5c3-e2b15035d60d tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] 10.222.0.57 "GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc" status: 200 len: 1315 microversion: 2.1 time: 0.181757 Dec 15 13:07:23.644027 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 329/724] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:23 2021] GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:23.855312 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ef05a58e-7aa7-4cba-aee2-2e8abd4d7cd2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:23.856295 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ef05a58e-7aa7-4cba-aee2-2e8abd4d7cd2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:23.865434 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ef05a58e-7aa7-4cba-aee2-2e8abd4d7cd2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:23.865884 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ef05a58e-7aa7-4cba-aee2-2e8abd4d7cd2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:23.866686 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ef05a58e-7aa7-4cba-aee2-2e8abd4d7cd2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:23.867114 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ef05a58e-7aa7-4cba-aee2-2e8abd4d7cd2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:23.898034 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ef05a58e-7aa7-4cba-aee2-2e8abd4d7cd2 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046358 Dec 15 13:07:23.898634 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 396/725] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:07:23 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:07:24.007146 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-ead73f54-e5a0-46d8-aa8d-a94f12ffdc3d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:24.007749 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-ead73f54-e5a0-46d8-aa8d-a94f12ffdc3d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:24.019118 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ead73f54-e5a0-46d8-aa8d-a94f12ffdc3d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:24.020064 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ead73f54-e5a0-46d8-aa8d-a94f12ffdc3d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:24.021422 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ead73f54-e5a0-46d8-aa8d-a94f12ffdc3d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:24.022222 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ead73f54-e5a0-46d8-aa8d-a94f12ffdc3d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:24.177028 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-ead73f54-e5a0-46d8-aa8d-a94f12ffdc3d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:24.187436 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-ead73f54-e5a0-46d8-aa8d-a94f12ffdc3d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:24.189361 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-ead73f54-e5a0-46d8-aa8d-a94f12ffdc3d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:24.190575 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-ead73f54-e5a0-46d8-aa8d-a94f12ffdc3d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.187101 Dec 15 13:07:24.191441 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 330/726] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:07:24 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:07:24.283554 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-64fccf0e-ec19-4b37-93d4-859e541a63ca tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:24.284820 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-64fccf0e-ec19-4b37-93d4-859e541a63ca tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:24.291879 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-64fccf0e-ec19-4b37-93d4-859e541a63ca tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:24.292414 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-64fccf0e-ec19-4b37-93d4-859e541a63ca tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:24.294049 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-64fccf0e-ec19-4b37-93d4-859e541a63ca tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:24.294719 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-64fccf0e-ec19-4b37-93d4-859e541a63ca tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:24.438370 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-64fccf0e-ec19-4b37-93d4-859e541a63ca tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:24.445942 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-64fccf0e-ec19-4b37-93d4-859e541a63ca tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1514 microversion: 2.1 time: 0.166436 Dec 15 13:07:24.458318 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 397/727] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:24 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:24.608347 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-7f8b980f-7f5f-493b-b8c3-02c570878a79 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:24.609504 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-7f8b980f-7f5f-493b-b8c3-02c570878a79 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:24.616181 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7f8b980f-7f5f-493b-b8c3-02c570878a79 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:24.616654 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7f8b980f-7f5f-493b-b8c3-02c570878a79 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:24.617594 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7f8b980f-7f5f-493b-b8c3-02c570878a79 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:24.618032 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7f8b980f-7f5f-493b-b8c3-02c570878a79 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:24.665181 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-3304e207-7441-408f-b443-9b5ea6f968ef tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:24.672212 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-3304e207-7441-408f-b443-9b5ea6f968ef tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] [instance: 68f4f473-3be6-4a7f-ae97-b125ff3a73fc] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:24.676949 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3304e207-7441-408f-b443-9b5ea6f968ef tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:24.678495 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3304e207-7441-408f-b443-9b5ea6f968ef tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:24.680841 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3304e207-7441-408f-b443-9b5ea6f968ef tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:24.682517 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3304e207-7441-408f-b443-9b5ea6f968ef tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:25.013242 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-7f8b980f-7f5f-493b-b8c3-02c570878a79 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:25.026431 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-7f8b980f-7f5f-493b-b8c3-02c570878a79 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1319 microversion: 2.1 time: 0.422583 Dec 15 13:07:25.036723 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 331/728] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:24 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1319 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:25.045157 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-582cb1d2-d79f-4427-a602-9215673c4c2a tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:25.046529 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-582cb1d2-d79f-4427-a602-9215673c4c2a tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:25.054550 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-582cb1d2-d79f-4427-a602-9215673c4c2a tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:25.055333 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-582cb1d2-d79f-4427-a602-9215673c4c2a tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:25.056338 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-582cb1d2-d79f-4427-a602-9215673c4c2a tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:25.056977 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-582cb1d2-d79f-4427-a602-9215673c4c2a tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:25.090734 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-3304e207-7441-408f-b443-9b5ea6f968ef tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d477d0eafb8448296405640b334d715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d936046d064508ba41edf0024c46e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:25.092154 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-582cb1d2-d79f-4427-a602-9215673c4c2a tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053128 Dec 15 13:07:25.093002 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 332/729] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:07:25 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:07:25.108737 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-3304e207-7441-408f-b443-9b5ea6f968ef tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] 10.222.0.57 "GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc" status: 200 len: 1315 microversion: 2.1 time: 0.451936 Dec 15 13:07:25.109482 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 398/730] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:24 2021] GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:25.209339 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-c62f16d8-9f43-4e71-9d75-17cac5182c07 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:25.209966 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-c62f16d8-9f43-4e71-9d75-17cac5182c07 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:25.219890 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c62f16d8-9f43-4e71-9d75-17cac5182c07 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:25.220358 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c62f16d8-9f43-4e71-9d75-17cac5182c07 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:25.221169 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c62f16d8-9f43-4e71-9d75-17cac5182c07 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:25.221602 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c62f16d8-9f43-4e71-9d75-17cac5182c07 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:25.388015 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-1c22b455-93ae-457d-b030-6e5e66ee5e39 req-2287de02-ca99-49de-94dc-6310a0d77248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8be01f4-a176-41ba-b710-1a2fe19b85f5", "name": "network-vif-plugged", "status": "completed", "tag": "10b5cfb7-0ae1-469d-b8d2-adb0846fc020"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:07:25.391242 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:07:25.391242 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:07:25.403795 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-1c22b455-93ae-457d-b030-6e5e66ee5e39 req-2287de02-ca99-49de-94dc-6310a0d77248 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:25.404629 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-1c22b455-93ae-457d-b030-6e5e66ee5e39 req-2287de02-ca99-49de-94dc-6310a0d77248 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:25.426241 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-1c22b455-93ae-457d-b030-6e5e66ee5e39 req-2287de02-ca99-49de-94dc-6310a0d77248 service nova] Creating event network-vif-plugged:10b5cfb7-0ae1-469d-b8d2-adb0846fc020 for instance d8be01f4-a176-41ba-b710-1a2fe19b85f5 on hv-cinder-81322 Dec 15 13:07:25.435947 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-1c22b455-93ae-457d-b030-6e5e66ee5e39 req-2287de02-ca99-49de-94dc-6310a0d77248 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053360 Dec 15 13:07:25.438077 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 399/731] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:07:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:07:25.484338 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-c62f16d8-9f43-4e71-9d75-17cac5182c07 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:25.495573 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-c62f16d8-9f43-4e71-9d75-17cac5182c07 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:25.498256 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-c62f16d8-9f43-4e71-9d75-17cac5182c07 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:25.499705 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-c62f16d8-9f43-4e71-9d75-17cac5182c07 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.294497 Dec 15 13:07:25.500846 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 333/732] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:07:25 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:07:25.807611 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ea6a8a95-64cf-4382-add1-476b85932557 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:25.808739 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ea6a8a95-64cf-4382-add1-476b85932557 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:25.816218 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ea6a8a95-64cf-4382-add1-476b85932557 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:25.816934 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ea6a8a95-64cf-4382-add1-476b85932557 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:25.817847 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ea6a8a95-64cf-4382-add1-476b85932557 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:25.818536 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ea6a8a95-64cf-4382-add1-476b85932557 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:25.970900 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ea6a8a95-64cf-4382-add1-476b85932557 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:25.978736 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ea6a8a95-64cf-4382-add1-476b85932557 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1514 microversion: 2.1 time: 0.175302 Dec 15 13:07:25.980620 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 400/733] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:25 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:25.996419 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-3e7bd064-6237-4d5d-95a0-78d070d1ebb7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dbf40fa4-931d-4793-b118-8fbaefdf4767"}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:07:25.998608 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-3e7bd064-6237-4d5d-95a0-78d070d1ebb7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:26.007993 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3e7bd064-6237-4d5d-95a0-78d070d1ebb7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:26.008632 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3e7bd064-6237-4d5d-95a0-78d070d1ebb7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:26.009261 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3e7bd064-6237-4d5d-95a0-78d070d1ebb7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:26.010207 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3e7bd064-6237-4d5d-95a0-78d070d1ebb7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:26.044635 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-157d7635-9c62-45ad-b02c-7d2e5e2045cc tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:26.045174 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-157d7635-9c62-45ad-b02c-7d2e5e2045cc tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:26.053143 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-157d7635-9c62-45ad-b02c-7d2e5e2045cc tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:26.053599 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-157d7635-9c62-45ad-b02c-7d2e5e2045cc tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:26.054432 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-157d7635-9c62-45ad-b02c-7d2e5e2045cc tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:26.054863 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-157d7635-9c62-45ad-b02c-7d2e5e2045cc tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:26.249152 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-157d7635-9c62-45ad-b02c-7d2e5e2045cc tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:26.260422 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-157d7635-9c62-45ad-b02c-7d2e5e2045cc tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1319 microversion: 2.1 time: 0.219891 Dec 15 13:07:26.262274 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 401/734] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:26 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:26.268517 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a5320750-f0d8-4306-bc59-9f558faf7cdb tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:26.269557 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a5320750-f0d8-4306-bc59-9f558faf7cdb tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] [instance: 68f4f473-3be6-4a7f-ae97-b125ff3a73fc] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:26.276213 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a5320750-f0d8-4306-bc59-9f558faf7cdb tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:26.277289 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a5320750-f0d8-4306-bc59-9f558faf7cdb tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:26.278593 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a5320750-f0d8-4306-bc59-9f558faf7cdb tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:26.279530 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a5320750-f0d8-4306-bc59-9f558faf7cdb tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:26.378269 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-3e7bd064-6237-4d5d-95a0-78d070d1ebb7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "POST /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.385158 Dec 15 13:07:26.380229 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 334/735] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Dec 15 13:07:25 2021] POST /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments => generated 194 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:07:26.397047 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-c2556270-0988-4757-9ebf-62fc089a7430 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:26.398873 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-c2556270-0988-4757-9ebf-62fc089a7430 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:26.410462 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c2556270-0988-4757-9ebf-62fc089a7430 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:26.411150 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c2556270-0988-4757-9ebf-62fc089a7430 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:26.412343 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c2556270-0988-4757-9ebf-62fc089a7430 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:26.412867 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c2556270-0988-4757-9ebf-62fc089a7430 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:26.463095 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-c2556270-0988-4757-9ebf-62fc089a7430 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Going to try to terminate instance {{(pid=116097) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:07:26.505037 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a5320750-f0d8-4306-bc59-9f558faf7cdb tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d477d0eafb8448296405640b334d715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d936046d064508ba41edf0024c46e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:26.524006 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a5320750-f0d8-4306-bc59-9f558faf7cdb tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] 10.222.0.57 "GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc" status: 200 len: 1315 microversion: 2.1 time: 0.259968 Dec 15 13:07:26.527099 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 402/736] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:26 2021] GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:26.537163 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-85655e80-6dd1-4c96-9284-4f7f01d8e237 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:26.538197 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-85655e80-6dd1-4c96-9284-4f7f01d8e237 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:26.553867 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-85655e80-6dd1-4c96-9284-4f7f01d8e237 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:26.554968 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-85655e80-6dd1-4c96-9284-4f7f01d8e237 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:26.556393 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-85655e80-6dd1-4c96-9284-4f7f01d8e237 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:26.557451 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-85655e80-6dd1-4c96-9284-4f7f01d8e237 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:26.632248 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-c2556270-0988-4757-9ebf-62fc089a7430 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "DELETE /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 204 len: 0 microversion: 2.1 time: 0.239022 Dec 15 13:07:26.633531 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 335/737] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Dec 15 13:07:26 2021] DELETE /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:07:26.652841 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-2755d82a-9662-49c2-9d22-3f72b7e54538 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:26.653662 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-2755d82a-9662-49c2-9d22-3f72b7e54538 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:26.671009 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2755d82a-9662-49c2-9d22-3f72b7e54538 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:26.671463 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2755d82a-9662-49c2-9d22-3f72b7e54538 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:26.672267 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2755d82a-9662-49c2-9d22-3f72b7e54538 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:26.672764 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2755d82a-9662-49c2-9d22-3f72b7e54538 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:26.774178 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-85655e80-6dd1-4c96-9284-4f7f01d8e237 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:26.791841 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-85655e80-6dd1-4c96-9284-4f7f01d8e237 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:26.793527 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-85655e80-6dd1-4c96-9284-4f7f01d8e237 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:26.794818 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-85655e80-6dd1-4c96-9284-4f7f01d8e237 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.265747 Dec 15 13:07:26.796044 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 403/738] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:07:26 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:07:26.842251 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-2755d82a-9662-49c2-9d22-3f72b7e54538 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:26.850047 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-2755d82a-9662-49c2-9d22-3f72b7e54538 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1514 microversion: 2.1 time: 0.202476 Dec 15 13:07:26.851240 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 336/739] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:26 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1514 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:27.277872 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-362e04f7-c54b-49cc-9128-a3af3cb7a33b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:27.279099 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-362e04f7-c54b-49cc-9128-a3af3cb7a33b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:27.285418 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-362e04f7-c54b-49cc-9128-a3af3cb7a33b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:27.285783 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-362e04f7-c54b-49cc-9128-a3af3cb7a33b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:27.286639 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-362e04f7-c54b-49cc-9128-a3af3cb7a33b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:27.287066 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-362e04f7-c54b-49cc-9128-a3af3cb7a33b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:27.423184 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-362e04f7-c54b-49cc-9128-a3af3cb7a33b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:27.430341 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-362e04f7-c54b-49cc-9128-a3af3cb7a33b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1319 microversion: 2.1 time: 0.156731 Dec 15 13:07:27.430908 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 404/740] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:27 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:27.560628 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-6c98025e-e4ed-4b3b-960d-175495f16776 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:27.562492 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-6c98025e-e4ed-4b3b-960d-175495f16776 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] [instance: 68f4f473-3be6-4a7f-ae97-b125ff3a73fc] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:27.569411 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6c98025e-e4ed-4b3b-960d-175495f16776 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:27.569882 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6c98025e-e4ed-4b3b-960d-175495f16776 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:27.570868 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6c98025e-e4ed-4b3b-960d-175495f16776 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:27.571328 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6c98025e-e4ed-4b3b-960d-175495f16776 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:27.706535 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-6c98025e-e4ed-4b3b-960d-175495f16776 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d477d0eafb8448296405640b334d715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d936046d064508ba41edf0024c46e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:27.714122 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-6c98025e-e4ed-4b3b-960d-175495f16776 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] 10.222.0.57 "GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc" status: 200 len: 1315 microversion: 2.1 time: 0.157204 Dec 15 13:07:27.715018 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 337/741] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:27 2021] GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:27.815185 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0af0e2f4-5bcb-41c8-acb2-e95a3e1875e5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:27.815702 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0af0e2f4-5bcb-41c8-acb2-e95a3e1875e5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:27.822484 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0af0e2f4-5bcb-41c8-acb2-e95a3e1875e5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:27.822937 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0af0e2f4-5bcb-41c8-acb2-e95a3e1875e5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:27.823729 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0af0e2f4-5bcb-41c8-acb2-e95a3e1875e5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:27.824738 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0af0e2f4-5bcb-41c8-acb2-e95a3e1875e5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:27.868086 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-e8493788-e200-48da-ae7f-9b62e89c40d1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:27.868999 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-e8493788-e200-48da-ae7f-9b62e89c40d1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:27.878592 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e8493788-e200-48da-ae7f-9b62e89c40d1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:27.879317 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e8493788-e200-48da-ae7f-9b62e89c40d1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:27.880495 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e8493788-e200-48da-ae7f-9b62e89c40d1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:27.881165 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e8493788-e200-48da-ae7f-9b62e89c40d1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:27.967626 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0af0e2f4-5bcb-41c8-acb2-e95a3e1875e5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:27.979689 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0af0e2f4-5bcb-41c8-acb2-e95a3e1875e5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:27.982165 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0af0e2f4-5bcb-41c8-acb2-e95a3e1875e5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:27.983703 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-0af0e2f4-5bcb-41c8-acb2-e95a3e1875e5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.172478 Dec 15 13:07:27.984491 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 405/742] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:07:27 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:07:28.030707 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-e8493788-e200-48da-ae7f-9b62e89c40d1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:28.038013 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-e8493788-e200-48da-ae7f-9b62e89c40d1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1514 microversion: 2.1 time: 0.173880 Dec 15 13:07:28.038637 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 338/743] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:27 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:28.446430 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-968983ad-1d58-4286-b314-a02db13feea6 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:28.447038 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-968983ad-1d58-4286-b314-a02db13feea6 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:28.455092 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-968983ad-1d58-4286-b314-a02db13feea6 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:28.455696 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-968983ad-1d58-4286-b314-a02db13feea6 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:28.457063 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-968983ad-1d58-4286-b314-a02db13feea6 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:28.457560 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-968983ad-1d58-4286-b314-a02db13feea6 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:28.599956 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-968983ad-1d58-4286-b314-a02db13feea6 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:28.607215 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-968983ad-1d58-4286-b314-a02db13feea6 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1319 microversion: 2.1 time: 0.164410 Dec 15 13:07:28.607776 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 406/744] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:28 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:28.731149 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-38757bac-213c-49c1-b2ec-86b359aad62f tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:28.731759 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-38757bac-213c-49c1-b2ec-86b359aad62f tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] [instance: 68f4f473-3be6-4a7f-ae97-b125ff3a73fc] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:28.737936 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-38757bac-213c-49c1-b2ec-86b359aad62f tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:28.738414 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-38757bac-213c-49c1-b2ec-86b359aad62f tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:28.739185 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-38757bac-213c-49c1-b2ec-86b359aad62f tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:28.739617 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-38757bac-213c-49c1-b2ec-86b359aad62f tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:28.871983 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-38757bac-213c-49c1-b2ec-86b359aad62f tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d477d0eafb8448296405640b334d715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d936046d064508ba41edf0024c46e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:28.879150 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-38757bac-213c-49c1-b2ec-86b359aad62f tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] 10.222.0.57 "GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc" status: 200 len: 1315 microversion: 2.1 time: 0.151634 Dec 15 13:07:28.879710 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 339/745] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:28 2021] GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:29.001546 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ce78221c-4302-42d1-9f2f-d2c4b169098d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:29.002270 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ce78221c-4302-42d1-9f2f-d2c4b169098d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:29.008695 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce78221c-4302-42d1-9f2f-d2c4b169098d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:29.009141 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce78221c-4302-42d1-9f2f-d2c4b169098d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:29.009919 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce78221c-4302-42d1-9f2f-d2c4b169098d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:29.010382 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce78221c-4302-42d1-9f2f-d2c4b169098d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:29.055166 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-5c24cd8f-4c0b-484f-ac13-a3c78d9cf428 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:29.057799 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-5c24cd8f-4c0b-484f-ac13-a3c78d9cf428 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:29.072327 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5c24cd8f-4c0b-484f-ac13-a3c78d9cf428 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:29.072327 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5c24cd8f-4c0b-484f-ac13-a3c78d9cf428 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:29.072327 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5c24cd8f-4c0b-484f-ac13-a3c78d9cf428 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:29.072327 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5c24cd8f-4c0b-484f-ac13-a3c78d9cf428 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:29.222955 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ce78221c-4302-42d1-9f2f-d2c4b169098d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:29.231634 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ce78221c-4302-42d1-9f2f-d2c4b169098d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:29.233125 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ce78221c-4302-42d1-9f2f-d2c4b169098d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:29.234298 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ce78221c-4302-42d1-9f2f-d2c4b169098d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.236364 Dec 15 13:07:29.244812 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 407/746] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:07:28 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:07:29.244812 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-4c733aff-81bd-4431-8a2d-bf78d6c44d63 req-781762e3-308b-4def-8ac7-fcec2d6e6f5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "703b5e88-39f0-436c-ac5a-f1701ec4d7c9", "name": "network-vif-plugged", "status": "completed", "tag": "82fec70a-827b-4ef1-8922-a834a47147e1"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:07:29.244812 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:07:29.244812 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:07:29.250294 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-4c733aff-81bd-4431-8a2d-bf78d6c44d63 req-781762e3-308b-4def-8ac7-fcec2d6e6f5e service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:29.250813 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-4c733aff-81bd-4431-8a2d-bf78d6c44d63 req-781762e3-308b-4def-8ac7-fcec2d6e6f5e service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:29.263440 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-4c733aff-81bd-4431-8a2d-bf78d6c44d63 req-781762e3-308b-4def-8ac7-fcec2d6e6f5e service nova] Creating event network-vif-plugged:82fec70a-827b-4ef1-8922-a834a47147e1 for instance 703b5e88-39f0-436c-ac5a-f1701ec4d7c9 on hv-cinder-81322 Dec 15 13:07:29.268558 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-4c733aff-81bd-4431-8a2d-bf78d6c44d63 req-781762e3-308b-4def-8ac7-fcec2d6e6f5e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032214 Dec 15 13:07:29.268756 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-5c24cd8f-4c0b-484f-ac13-a3c78d9cf428 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:29.269425 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 408/747] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:07:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:07:29.279525 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-5c24cd8f-4c0b-484f-ac13-a3c78d9cf428 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1514 microversion: 2.1 time: 0.227818 Dec 15 13:07:29.280097 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 340/748] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:29 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1514 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:29.627087 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-20fb1fe8-413a-4a09-a96d-08f292c74e08 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:29.627781 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-20fb1fe8-413a-4a09-a96d-08f292c74e08 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:29.637990 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-20fb1fe8-413a-4a09-a96d-08f292c74e08 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:29.638493 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-20fb1fe8-413a-4a09-a96d-08f292c74e08 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:29.639307 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-20fb1fe8-413a-4a09-a96d-08f292c74e08 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:29.639918 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-20fb1fe8-413a-4a09-a96d-08f292c74e08 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:29.776592 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-20fb1fe8-413a-4a09-a96d-08f292c74e08 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:29.786021 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-20fb1fe8-413a-4a09-a96d-08f292c74e08 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1319 microversion: 2.1 time: 0.165535 Dec 15 13:07:29.786685 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 409/749] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:29 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:29.896707 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-c6132715-bd5b-4aec-9293-9878110dae09 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:29.897441 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-c6132715-bd5b-4aec-9293-9878110dae09 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] [instance: 68f4f473-3be6-4a7f-ae97-b125ff3a73fc] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:29.904401 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c6132715-bd5b-4aec-9293-9878110dae09 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:29.904846 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c6132715-bd5b-4aec-9293-9878110dae09 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:29.905825 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c6132715-bd5b-4aec-9293-9878110dae09 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:29.906452 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c6132715-bd5b-4aec-9293-9878110dae09 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:30.053966 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-c6132715-bd5b-4aec-9293-9878110dae09 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d477d0eafb8448296405640b334d715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d936046d064508ba41edf0024c46e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:30.063980 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-c6132715-bd5b-4aec-9293-9878110dae09 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] 10.222.0.57 "GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc" status: 200 len: 1315 microversion: 2.1 time: 0.170711 Dec 15 13:07:30.064740 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 341/750] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:29 2021] GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:30.251610 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-63554974-1c0d-4f2c-860a-4fb3280c6f55 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:30.252214 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-63554974-1c0d-4f2c-860a-4fb3280c6f55 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:30.258511 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-63554974-1c0d-4f2c-860a-4fb3280c6f55 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:30.258953 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-63554974-1c0d-4f2c-860a-4fb3280c6f55 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:30.259914 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-63554974-1c0d-4f2c-860a-4fb3280c6f55 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:30.260502 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-63554974-1c0d-4f2c-860a-4fb3280c6f55 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:30.298575 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-520586bd-2a98-446a-a3f8-d83a3fb79856 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:30.299337 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-520586bd-2a98-446a-a3f8-d83a3fb79856 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:30.305957 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-520586bd-2a98-446a-a3f8-d83a3fb79856 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:30.306402 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-520586bd-2a98-446a-a3f8-d83a3fb79856 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:30.307236 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-520586bd-2a98-446a-a3f8-d83a3fb79856 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:30.307680 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-520586bd-2a98-446a-a3f8-d83a3fb79856 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:30.414441 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-63554974-1c0d-4f2c-860a-4fb3280c6f55 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:30.425233 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-63554974-1c0d-4f2c-860a-4fb3280c6f55 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:30.426967 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-63554974-1c0d-4f2c-860a-4fb3280c6f55 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:30.428315 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-63554974-1c0d-4f2c-860a-4fb3280c6f55 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.180300 Dec 15 13:07:30.429030 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 410/751] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:07:30 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:07:30.484970 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-520586bd-2a98-446a-a3f8-d83a3fb79856 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:30.493019 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-520586bd-2a98-446a-a3f8-d83a3fb79856 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1514 microversion: 2.1 time: 0.199968 Dec 15 13:07:30.493785 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 342/752] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:30 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1514 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:30.804907 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-119176f0-aeb2-4f57-855b-e1debe6774d3 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:30.806319 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-119176f0-aeb2-4f57-855b-e1debe6774d3 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:30.814499 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-119176f0-aeb2-4f57-855b-e1debe6774d3 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:30.815618 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-119176f0-aeb2-4f57-855b-e1debe6774d3 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:30.816721 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-119176f0-aeb2-4f57-855b-e1debe6774d3 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:30.817583 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-119176f0-aeb2-4f57-855b-e1debe6774d3 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:30.968399 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-119176f0-aeb2-4f57-855b-e1debe6774d3 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:30.976027 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-119176f0-aeb2-4f57-855b-e1debe6774d3 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1507 microversion: 2.1 time: 0.176503 Dec 15 13:07:30.976710 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 411/753] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:30 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1507 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:30.993547 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-95471f21-30e4-488d-9e3b-50a4758a7cf0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "938e9333-70b9-4b2d-9da5-b6af60ba5dca", "device": "/dev/sdb"}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:07:30.995281 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-95471f21-30e4-488d-9e3b-50a4758a7cf0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:31.002385 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-95471f21-30e4-488d-9e3b-50a4758a7cf0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:31.003089 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-95471f21-30e4-488d-9e3b-50a4758a7cf0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:31.004081 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-95471f21-30e4-488d-9e3b-50a4758a7cf0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:31.004521 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-95471f21-30e4-488d-9e3b-50a4758a7cf0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:31.080383 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c57e86a1-66b9-477c-924c-a8a23d875228 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:31.081326 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c57e86a1-66b9-477c-924c-a8a23d875228 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] [instance: 68f4f473-3be6-4a7f-ae97-b125ff3a73fc] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:31.088241 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c57e86a1-66b9-477c-924c-a8a23d875228 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:31.088691 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c57e86a1-66b9-477c-924c-a8a23d875228 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:31.090076 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c57e86a1-66b9-477c-924c-a8a23d875228 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:31.090561 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c57e86a1-66b9-477c-924c-a8a23d875228 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:31.320252 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c57e86a1-66b9-477c-924c-a8a23d875228 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d477d0eafb8448296405640b334d715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d936046d064508ba41edf0024c46e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:31.329559 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c57e86a1-66b9-477c-924c-a8a23d875228 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] 10.222.0.57 "GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc" status: 200 len: 1315 microversion: 2.1 time: 0.252710 Dec 15 13:07:31.330290 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 412/754] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:31 2021] GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:31.401439 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-95471f21-30e4-488d-9e3b-50a4758a7cf0 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "POST /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.411865 Dec 15 13:07:31.415305 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 343/755] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Dec 15 13:07:30 2021] POST /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5/os-volume_attachments => generated 194 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:07:31.448138 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a3d35935-e181-439a-9717-f54748569cf2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:31.449656 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a3d35935-e181-439a-9717-f54748569cf2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:31.460370 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a3d35935-e181-439a-9717-f54748569cf2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:31.460809 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a3d35935-e181-439a-9717-f54748569cf2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:31.461596 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a3d35935-e181-439a-9717-f54748569cf2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:31.462028 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a3d35935-e181-439a-9717-f54748569cf2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:31.511322 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-27f2990a-d5fd-416b-8dbe-03fee99824ea tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:31.512552 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-27f2990a-d5fd-416b-8dbe-03fee99824ea tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:31.537892 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-27f2990a-d5fd-416b-8dbe-03fee99824ea tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:31.539109 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-27f2990a-d5fd-416b-8dbe-03fee99824ea tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:31.540321 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-27f2990a-d5fd-416b-8dbe-03fee99824ea tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:31.540757 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-27f2990a-d5fd-416b-8dbe-03fee99824ea tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:31.678813 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a3d35935-e181-439a-9717-f54748569cf2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:31.688831 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a3d35935-e181-439a-9717-f54748569cf2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:31.707250 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a3d35935-e181-439a-9717-f54748569cf2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:31.708721 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a3d35935-e181-439a-9717-f54748569cf2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.265220 Dec 15 13:07:31.721615 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 413/756] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:07:31 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:07:31.806019 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-27f2990a-d5fd-416b-8dbe-03fee99824ea tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:31.819534 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-27f2990a-d5fd-416b-8dbe-03fee99824ea tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1514 microversion: 2.1 time: 0.312549 Dec 15 13:07:31.820420 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 344/757] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:31 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1514 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:32.230950 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-f460c4c1-d62f-4f90-8f7b-256216975f15 req-179b9ce6-2dd9-4f4d-a046-e2a71fba046a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "538de0dc-a820-43f0-8b8f-0966f219e960", "name": "network-vif-deleted", "tag": "37796afb-3b88-4e52-8372-230d4df65445"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:07:32.232968 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:07:32.232968 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:07:32.241517 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-f460c4c1-d62f-4f90-8f7b-256216975f15 req-179b9ce6-2dd9-4f4d-a046-e2a71fba046a service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:32.242431 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-f460c4c1-d62f-4f90-8f7b-256216975f15 req-179b9ce6-2dd9-4f4d-a046-e2a71fba046a service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:32.255758 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-f460c4c1-d62f-4f90-8f7b-256216975f15 req-179b9ce6-2dd9-4f4d-a046-e2a71fba046a service nova] Creating event network-vif-deleted:37796afb-3b88-4e52-8372-230d4df65445 for instance 538de0dc-a820-43f0-8b8f-0966f219e960 on hv-cinder-81322 Dec 15 13:07:32.261435 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-f460c4c1-d62f-4f90-8f7b-256216975f15 req-179b9ce6-2dd9-4f4d-a046-e2a71fba046a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034658 Dec 15 13:07:32.265767 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 414/758] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:07:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:07:32.347124 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-2b36034e-68f9-48e2-ba6e-0efe45ea3c6a tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:32.347929 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-2b36034e-68f9-48e2-ba6e-0efe45ea3c6a tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] [instance: 68f4f473-3be6-4a7f-ae97-b125ff3a73fc] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:32.356894 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2b36034e-68f9-48e2-ba6e-0efe45ea3c6a tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:32.362242 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2b36034e-68f9-48e2-ba6e-0efe45ea3c6a tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:32.364487 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2b36034e-68f9-48e2-ba6e-0efe45ea3c6a tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:32.365716 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2b36034e-68f9-48e2-ba6e-0efe45ea3c6a tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:32.562062 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-2b36034e-68f9-48e2-ba6e-0efe45ea3c6a tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d477d0eafb8448296405640b334d715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d936046d064508ba41edf0024c46e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:32.572513 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-2b36034e-68f9-48e2-ba6e-0efe45ea3c6a tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] 10.222.0.57 "GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc" status: 200 len: 1315 microversion: 2.1 time: 0.228420 Dec 15 13:07:32.573670 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 345/759] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:32 2021] GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:32.729335 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-506d00ec-3035-44ad-afb1-156ccedb2c93 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:32.730017 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-506d00ec-3035-44ad-afb1-156ccedb2c93 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:32.736916 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-506d00ec-3035-44ad-afb1-156ccedb2c93 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:32.737315 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-506d00ec-3035-44ad-afb1-156ccedb2c93 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:32.738089 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-506d00ec-3035-44ad-afb1-156ccedb2c93 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:32.738556 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-506d00ec-3035-44ad-afb1-156ccedb2c93 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:32.837529 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-22c3e11a-c80a-42b3-ad25-6f3f360c5b76 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:32.838443 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-22c3e11a-c80a-42b3-ad25-6f3f360c5b76 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:32.845987 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-22c3e11a-c80a-42b3-ad25-6f3f360c5b76 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:32.846713 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-22c3e11a-c80a-42b3-ad25-6f3f360c5b76 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:32.848431 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-22c3e11a-c80a-42b3-ad25-6f3f360c5b76 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:32.849340 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-22c3e11a-c80a-42b3-ad25-6f3f360c5b76 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:32.885630 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-22c3e11a-c80a-42b3-ad25-6f3f360c5b76 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:32.886081 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-22c3e11a-c80a-42b3-ad25-6f3f360c5b76 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:32.887252 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.objects.instance [None req-22c3e11a-c80a-42b3-ad25-6f3f360c5b76 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lazy-loading 'fault' on Instance uuid 538de0dc-a820-43f0-8b8f-0966f219e960 {{(pid=116097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:07:32.908812 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-506d00ec-3035-44ad-afb1-156ccedb2c93 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:32.919993 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-506d00ec-3035-44ad-afb1-156ccedb2c93 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:32.922664 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-506d00ec-3035-44ad-afb1-156ccedb2c93 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:32.923834 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-506d00ec-3035-44ad-afb1-156ccedb2c93 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.198655 Dec 15 13:07:32.924547 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 415/760] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:07:32 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:07:32.929250 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-22c3e11a-c80a-42b3-ad25-6f3f360c5b76 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:32.942453 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-22c3e11a-c80a-42b3-ad25-6f3f360c5b76 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 200 len: 1308 microversion: 2.1 time: 0.109020 Dec 15 13:07:32.943567 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 346/761] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:32 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 1308 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:33.119333 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-672afcb3-3055-4eee-9b5b-3bc24f882a0b req-a8b09d3e-ce5b-49c4-87d5-5d4ea1675c15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f4f473-3be6-4a7f-ae97-b125ff3a73fc", "name": "network-vif-plugged", "status": "completed", "tag": "58ae3c4f-f2b1-4ff8-b5b6-e2fb549417d3"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:07:33.121170 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:07:33.121170 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:07:33.130327 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-672afcb3-3055-4eee-9b5b-3bc24f882a0b req-a8b09d3e-ce5b-49c4-87d5-5d4ea1675c15 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:33.131931 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-672afcb3-3055-4eee-9b5b-3bc24f882a0b req-a8b09d3e-ce5b-49c4-87d5-5d4ea1675c15 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:33.148886 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-672afcb3-3055-4eee-9b5b-3bc24f882a0b req-a8b09d3e-ce5b-49c4-87d5-5d4ea1675c15 service nova] Creating event network-vif-plugged:58ae3c4f-f2b1-4ff8-b5b6-e2fb549417d3 for instance 68f4f473-3be6-4a7f-ae97-b125ff3a73fc on hv-cinder-81322 Dec 15 13:07:33.156160 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-672afcb3-3055-4eee-9b5b-3bc24f882a0b req-a8b09d3e-ce5b-49c4-87d5-5d4ea1675c15 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042774 Dec 15 13:07:33.157127 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 416/762] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:07:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:07:33.593440 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-b25e041b-c4d8-4ede-ba49-3b5a482a9a82 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:33.594746 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-b25e041b-c4d8-4ede-ba49-3b5a482a9a82 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] [instance: 68f4f473-3be6-4a7f-ae97-b125ff3a73fc] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:33.603894 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b25e041b-c4d8-4ede-ba49-3b5a482a9a82 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:33.605103 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b25e041b-c4d8-4ede-ba49-3b5a482a9a82 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:33.606260 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b25e041b-c4d8-4ede-ba49-3b5a482a9a82 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:33.607452 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b25e041b-c4d8-4ede-ba49-3b5a482a9a82 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:33.883979 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-b25e041b-c4d8-4ede-ba49-3b5a482a9a82 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d477d0eafb8448296405640b334d715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d936046d064508ba41edf0024c46e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:33.893483 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-b25e041b-c4d8-4ede-ba49-3b5a482a9a82 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] 10.222.0.57 "GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc" status: 200 len: 1315 microversion: 2.1 time: 0.306182 Dec 15 13:07:33.894524 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 347/763] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:33 2021] GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:33.948164 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-bb606c5c-7e07-4318-a1f0-992d031fc9da tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:33.950676 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-bb606c5c-7e07-4318-a1f0-992d031fc9da tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:33.960673 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-094ed29f-935b-4373-9c71-ff474c55d442 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:33.961469 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-094ed29f-935b-4373-9c71-ff474c55d442 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: 538de0dc-a820-43f0-8b8f-0966f219e960] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:33.973064 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-094ed29f-935b-4373-9c71-ff474c55d442 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:33.974529 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bb606c5c-7e07-4318-a1f0-992d031fc9da tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:33.975811 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bb606c5c-7e07-4318-a1f0-992d031fc9da tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:33.976101 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-094ed29f-935b-4373-9c71-ff474c55d442 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:33.977773 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-094ed29f-935b-4373-9c71-ff474c55d442 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:33.978886 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bb606c5c-7e07-4318-a1f0-992d031fc9da tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:33.979322 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bb606c5c-7e07-4318-a1f0-992d031fc9da tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:33.980799 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-094ed29f-935b-4373-9c71-ff474c55d442 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:33.998972 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.wsgi [None req-094ed29f-935b-4373-9c71-ff474c55d442 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] HTTP exception thrown: Instance 538de0dc-a820-43f0-8b8f-0966f219e960 could not be found. Dec 15 13:07:33.999804 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-094ed29f-935b-4373-9c71-ff474c55d442 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Returning 404 to user: Instance 538de0dc-a820-43f0-8b8f-0966f219e960 could not be found. {{(pid=116097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:07:34.000785 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-094ed29f-935b-4373-9c71-ff474c55d442 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960" status: 404 len: 111 microversion: 2.1 time: 0.044445 Dec 15 13:07:34.001506 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 348/764] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:33 2021] GET /compute/v2.1/servers/538de0dc-a820-43f0-8b8f-0966f219e960 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 13:07:34.184035 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-bb606c5c-7e07-4318-a1f0-992d031fc9da tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:34.193638 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-bb606c5c-7e07-4318-a1f0-992d031fc9da tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:34.195399 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-bb606c5c-7e07-4318-a1f0-992d031fc9da tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:34.196957 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-bb606c5c-7e07-4318-a1f0-992d031fc9da tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1807 microversion: 2.20 time: 0.256769 Dec 15 13:07:34.198058 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 417/765] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:07:33 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1807 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:07:34.909588 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-c39446de-2c06-4e14-bc9b-46dfe95eea13 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:34.910357 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-c39446de-2c06-4e14-bc9b-46dfe95eea13 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] [instance: 68f4f473-3be6-4a7f-ae97-b125ff3a73fc] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:34.918420 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c39446de-2c06-4e14-bc9b-46dfe95eea13 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:34.919390 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c39446de-2c06-4e14-bc9b-46dfe95eea13 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:34.920488 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c39446de-2c06-4e14-bc9b-46dfe95eea13 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:34.921020 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c39446de-2c06-4e14-bc9b-46dfe95eea13 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:35.030302 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-2e1f76fc-3583-483f-9f04-75e64b1fa0db tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:07:35.031327 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-2e1f76fc-3583-483f-9f04-75e64b1fa0db tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:35.039850 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2e1f76fc-3583-483f-9f04-75e64b1fa0db tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:35.040407 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2e1f76fc-3583-483f-9f04-75e64b1fa0db tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:35.041510 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2e1f76fc-3583-483f-9f04-75e64b1fa0db tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:35.041952 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2e1f76fc-3583-483f-9f04-75e64b1fa0db tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:35.072079 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.objects.instance [None req-2e1f76fc-3583-483f-9f04-75e64b1fa0db tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lazy-loading 'flavor' on Instance uuid 46358568-c4cc-4dd2-81e7-c724c57ee533 {{(pid=116098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:07:35.079951 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-c39446de-2c06-4e14-bc9b-46dfe95eea13 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d477d0eafb8448296405640b334d715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d936046d064508ba41edf0024c46e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:35.087427 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-c39446de-2c06-4e14-bc9b-46dfe95eea13 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] 10.222.0.57 "GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc" status: 200 len: 1315 microversion: 2.1 time: 0.181214 Dec 15 13:07:35.097245 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 349/766] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:34 2021] GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:35.173641 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-e105363e-b11a-4ebb-b9de-ba8fd24b131a tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:35.174514 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-e105363e-b11a-4ebb-b9de-ba8fd24b131a tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:35.181185 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e105363e-b11a-4ebb-b9de-ba8fd24b131a tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:35.181688 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e105363e-b11a-4ebb-b9de-ba8fd24b131a tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:35.182517 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e105363e-b11a-4ebb-b9de-ba8fd24b131a tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:35.182954 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e105363e-b11a-4ebb-b9de-ba8fd24b131a tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:35.209492 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-e105363e-b11a-4ebb-b9de-ba8fd24b131a tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Going to try to terminate instance {{(pid=116097) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:07:35.211863 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-2e1f76fc-3583-483f-9f04-75e64b1fa0db tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "POST /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/action" status: 200 len: 32 microversion: 2.1 time: 0.186565 Dec 15 13:07:35.212470 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 418/767] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:07:35 2021] POST /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/action => generated 32 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:07:35.219982 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-dbd35306-1b5f-4269-a7ea-ef3951cabc42 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:35.220924 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-dbd35306-1b5f-4269-a7ea-ef3951cabc42 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:35.234427 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dbd35306-1b5f-4269-a7ea-ef3951cabc42 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:35.235035 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dbd35306-1b5f-4269-a7ea-ef3951cabc42 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:35.235997 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dbd35306-1b5f-4269-a7ea-ef3951cabc42 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:35.236845 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dbd35306-1b5f-4269-a7ea-ef3951cabc42 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:35.307937 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-e105363e-b11a-4ebb-b9de-ba8fd24b131a tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 204 len: 0 microversion: 2.1 time: 0.137471 Dec 15 13:07:35.310022 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 350/768] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Dec 15 13:07:35 2021] DELETE /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:07:35.321647 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-4d84ee5d-8bc2-40ee-be9a-697f19e438b4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:35.322586 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-4d84ee5d-8bc2-40ee-be9a-697f19e438b4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:35.330848 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4d84ee5d-8bc2-40ee-be9a-697f19e438b4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:35.331420 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4d84ee5d-8bc2-40ee-be9a-697f19e438b4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:35.335715 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4d84ee5d-8bc2-40ee-be9a-697f19e438b4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:35.336285 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4d84ee5d-8bc2-40ee-be9a-697f19e438b4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:35.395922 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-dbd35306-1b5f-4269-a7ea-ef3951cabc42 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:35.404473 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-dbd35306-1b5f-4269-a7ea-ef3951cabc42 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:35.406037 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-dbd35306-1b5f-4269-a7ea-ef3951cabc42 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:35.407360 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-dbd35306-1b5f-4269-a7ea-ef3951cabc42 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1794 microversion: 2.20 time: 0.191439 Dec 15 13:07:35.410193 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 419/769] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:07:35 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1794 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:07:35.412504 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-da26dd83-a5b6-4d37-9fd2-25be7b2e1c6c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:35.413108 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-da26dd83-a5b6-4d37-9fd2-25be7b2e1c6c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:35.420113 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-da26dd83-a5b6-4d37-9fd2-25be7b2e1c6c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:35.420539 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-da26dd83-a5b6-4d37-9fd2-25be7b2e1c6c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:35.421317 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-da26dd83-a5b6-4d37-9fd2-25be7b2e1c6c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:35.421751 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-da26dd83-a5b6-4d37-9fd2-25be7b2e1c6c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:35.580770 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-da26dd83-a5b6-4d37-9fd2-25be7b2e1c6c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:35.588985 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-da26dd83-a5b6-4d37-9fd2-25be7b2e1c6c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1513 microversion: 2.1 time: 0.179716 Dec 15 13:07:35.594408 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 420/770] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:35 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:35.956877 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-4d84ee5d-8bc2-40ee-be9a-697f19e438b4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:35.967709 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-4d84ee5d-8bc2-40ee-be9a-697f19e438b4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.655480 Dec 15 13:07:35.969324 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 351/771] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:35 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:36.105667 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-dd2f9bbe-ed28-4c15-81cc-538a0cabdd77 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:36.106515 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-dd2f9bbe-ed28-4c15-81cc-538a0cabdd77 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] [instance: 68f4f473-3be6-4a7f-ae97-b125ff3a73fc] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:36.115627 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dd2f9bbe-ed28-4c15-81cc-538a0cabdd77 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:36.118741 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dd2f9bbe-ed28-4c15-81cc-538a0cabdd77 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:36.119546 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dd2f9bbe-ed28-4c15-81cc-538a0cabdd77 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:36.120698 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dd2f9bbe-ed28-4c15-81cc-538a0cabdd77 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:36.269247 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-dd2f9bbe-ed28-4c15-81cc-538a0cabdd77 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d477d0eafb8448296405640b334d715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d936046d064508ba41edf0024c46e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:36.279609 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-dd2f9bbe-ed28-4c15-81cc-538a0cabdd77 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] 10.222.0.57 "GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc" status: 200 len: 1315 microversion: 2.1 time: 0.176898 Dec 15 13:07:36.281034 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 421/772] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:36 2021] GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:36.606524 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-03fce116-3165-40f5-8e4c-62c07a8d624c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:36.606882 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-03fce116-3165-40f5-8e4c-62c07a8d624c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:36.612943 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-03fce116-3165-40f5-8e4c-62c07a8d624c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:36.613388 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-03fce116-3165-40f5-8e4c-62c07a8d624c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:36.614185 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-03fce116-3165-40f5-8e4c-62c07a8d624c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:36.614620 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-03fce116-3165-40f5-8e4c-62c07a8d624c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:36.753777 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-03fce116-3165-40f5-8e4c-62c07a8d624c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:36.761627 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-03fce116-3165-40f5-8e4c-62c07a8d624c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1513 microversion: 2.1 time: 0.158757 Dec 15 13:07:36.762306 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 352/773] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:36 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:36.989591 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-193d9e2d-8a4c-4b9b-bb17-5fd3759e06cd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:36.990253 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-193d9e2d-8a4c-4b9b-bb17-5fd3759e06cd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:36.997077 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-193d9e2d-8a4c-4b9b-bb17-5fd3759e06cd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:36.997490 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-193d9e2d-8a4c-4b9b-bb17-5fd3759e06cd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:36.998325 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-193d9e2d-8a4c-4b9b-bb17-5fd3759e06cd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:36.998793 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-193d9e2d-8a4c-4b9b-bb17-5fd3759e06cd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:37.149122 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-193d9e2d-8a4c-4b9b-bb17-5fd3759e06cd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:37.157293 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-193d9e2d-8a4c-4b9b-bb17-5fd3759e06cd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.171473 Dec 15 13:07:37.158402 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 422/774] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:36 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:37.297669 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-fc890b89-46c6-4863-bd96-6ecc365e05d5 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:37.298351 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-fc890b89-46c6-4863-bd96-6ecc365e05d5 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] [instance: 68f4f473-3be6-4a7f-ae97-b125ff3a73fc] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:37.305258 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fc890b89-46c6-4863-bd96-6ecc365e05d5 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:37.306003 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fc890b89-46c6-4863-bd96-6ecc365e05d5 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:37.307029 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fc890b89-46c6-4863-bd96-6ecc365e05d5 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:37.307644 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fc890b89-46c6-4863-bd96-6ecc365e05d5 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:37.439692 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-fc890b89-46c6-4863-bd96-6ecc365e05d5 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d477d0eafb8448296405640b334d715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d936046d064508ba41edf0024c46e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:37.447209 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-fc890b89-46c6-4863-bd96-6ecc365e05d5 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] 10.222.0.57 "GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc" status: 200 len: 1315 microversion: 2.1 time: 0.153572 Dec 15 13:07:37.447866 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 353/775] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:37 2021] GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:37.779737 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a8c54b7e-249e-4fb6-8389-5d93e0b61444 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:37.780354 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a8c54b7e-249e-4fb6-8389-5d93e0b61444 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:37.786267 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a8c54b7e-249e-4fb6-8389-5d93e0b61444 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:37.786878 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a8c54b7e-249e-4fb6-8389-5d93e0b61444 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:37.787657 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a8c54b7e-249e-4fb6-8389-5d93e0b61444 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:37.788091 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a8c54b7e-249e-4fb6-8389-5d93e0b61444 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:37.946658 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a8c54b7e-249e-4fb6-8389-5d93e0b61444 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:37.954045 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a8c54b7e-249e-4fb6-8389-5d93e0b61444 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1513 microversion: 2.1 time: 0.178151 Dec 15 13:07:37.954654 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 423/776] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:37 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1513 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:38.174309 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-d07cbdfd-f04c-4332-ab1a-4a18f4f9afb8 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:38.175096 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-d07cbdfd-f04c-4332-ab1a-4a18f4f9afb8 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:38.181630 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d07cbdfd-f04c-4332-ab1a-4a18f4f9afb8 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:38.182183 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d07cbdfd-f04c-4332-ab1a-4a18f4f9afb8 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:38.183696 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d07cbdfd-f04c-4332-ab1a-4a18f4f9afb8 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:38.184145 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d07cbdfd-f04c-4332-ab1a-4a18f4f9afb8 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:38.328044 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-d07cbdfd-f04c-4332-ab1a-4a18f4f9afb8 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:38.335969 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-d07cbdfd-f04c-4332-ab1a-4a18f4f9afb8 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.165284 Dec 15 13:07:38.345977 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 354/777] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:38 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:38.465214 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-71ee6e3a-a201-4eee-9fd7-df2458b4603e tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:38.466601 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-71ee6e3a-a201-4eee-9fd7-df2458b4603e tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] [instance: 68f4f473-3be6-4a7f-ae97-b125ff3a73fc] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:38.473462 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-71ee6e3a-a201-4eee-9fd7-df2458b4603e tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:38.473911 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-71ee6e3a-a201-4eee-9fd7-df2458b4603e tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:38.474738 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-71ee6e3a-a201-4eee-9fd7-df2458b4603e tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:38.475314 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-71ee6e3a-a201-4eee-9fd7-df2458b4603e tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:38.629438 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-71ee6e3a-a201-4eee-9fd7-df2458b4603e tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d477d0eafb8448296405640b334d715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d936046d064508ba41edf0024c46e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:38.637164 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-71ee6e3a-a201-4eee-9fd7-df2458b4603e tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] 10.222.0.57 "GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc" status: 200 len: 1315 microversion: 2.1 time: 0.176275 Dec 15 13:07:38.637940 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 424/778] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:38 2021] GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:38.970636 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-ee7e35c2-d56d-4016-8c27-b896fbbdfd18 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:38.971241 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-ee7e35c2-d56d-4016-8c27-b896fbbdfd18 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:38.979596 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ee7e35c2-d56d-4016-8c27-b896fbbdfd18 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:38.980575 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ee7e35c2-d56d-4016-8c27-b896fbbdfd18 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:38.981354 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ee7e35c2-d56d-4016-8c27-b896fbbdfd18 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:38.981788 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ee7e35c2-d56d-4016-8c27-b896fbbdfd18 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:39.216462 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-ee7e35c2-d56d-4016-8c27-b896fbbdfd18 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:39.224646 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-ee7e35c2-d56d-4016-8c27-b896fbbdfd18 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 200 len: 1513 microversion: 2.1 time: 0.257566 Dec 15 13:07:39.236117 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 355/779] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:38 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 1513 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:39.352923 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-2c952a40-ebd3-41aa-8358-ca8663e85dc0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:39.353811 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-2c952a40-ebd3-41aa-8358-ca8663e85dc0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:39.364434 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2c952a40-ebd3-41aa-8358-ca8663e85dc0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:39.365090 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2c952a40-ebd3-41aa-8358-ca8663e85dc0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:39.365676 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2c952a40-ebd3-41aa-8358-ca8663e85dc0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:39.366228 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2c952a40-ebd3-41aa-8358-ca8663e85dc0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:39.411452 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-843089a0-db78-402a-87b7-6013d145bba3 req-3da12754-6499-4aa7-ad99-bcdb299d18e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5b657b8-e2d6-4365-b369-0accd054202d", "name": "network-vif-deleted", "tag": "689e019e-fb09-49a1-a85f-3e8039f5d870"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:07:39.414294 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:07:39.414294 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:07:39.432782 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-843089a0-db78-402a-87b7-6013d145bba3 req-3da12754-6499-4aa7-ad99-bcdb299d18e3 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:39.433515 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-843089a0-db78-402a-87b7-6013d145bba3 req-3da12754-6499-4aa7-ad99-bcdb299d18e3 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:39.475453 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-843089a0-db78-402a-87b7-6013d145bba3 req-3da12754-6499-4aa7-ad99-bcdb299d18e3 service nova] Creating event network-vif-deleted:689e019e-fb09-49a1-a85f-3e8039f5d870 for instance e5b657b8-e2d6-4365-b369-0accd054202d on hv-cinder-81322 Dec 15 13:07:39.499058 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-843089a0-db78-402a-87b7-6013d145bba3 req-3da12754-6499-4aa7-ad99-bcdb299d18e3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090989 Dec 15 13:07:39.499985 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 356/780] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:07:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:07:39.598803 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-2c952a40-ebd3-41aa-8358-ca8663e85dc0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:39.607183 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-2c952a40-ebd3-41aa-8358-ca8663e85dc0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.258182 Dec 15 13:07:39.608055 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 425/781] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:39 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:39.656137 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-b504fc58-133d-458e-9dc4-7749059caefc tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:39.657117 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-b504fc58-133d-458e-9dc4-7749059caefc tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] [instance: 68f4f473-3be6-4a7f-ae97-b125ff3a73fc] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:39.663438 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b504fc58-133d-458e-9dc4-7749059caefc tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:39.664190 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b504fc58-133d-458e-9dc4-7749059caefc tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:39.665210 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b504fc58-133d-458e-9dc4-7749059caefc tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:39.665840 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b504fc58-133d-458e-9dc4-7749059caefc tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:39.821572 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-b504fc58-133d-458e-9dc4-7749059caefc tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d477d0eafb8448296405640b334d715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d936046d064508ba41edf0024c46e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:39.829554 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-b504fc58-133d-458e-9dc4-7749059caefc tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] 10.222.0.57 "GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc" status: 200 len: 1464 microversion: 2.1 time: 0.178177 Dec 15 13:07:39.842500 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 357/782] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:39 2021] GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc => generated 1464 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:39.872544 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-baef81ac-5b98-4fe9-96bf-00c5a045b70d tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:39.873154 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-baef81ac-5b98-4fe9-96bf-00c5a045b70d tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] [instance: 68f4f473-3be6-4a7f-ae97-b125ff3a73fc] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:39.879379 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-baef81ac-5b98-4fe9-96bf-00c5a045b70d tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:39.879829 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-baef81ac-5b98-4fe9-96bf-00c5a045b70d tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:39.880623 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-baef81ac-5b98-4fe9-96bf-00c5a045b70d tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:39.881053 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-baef81ac-5b98-4fe9-96bf-00c5a045b70d tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:39.914055 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-baef81ac-5b98-4fe9-96bf-00c5a045b70d tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] [instance: 68f4f473-3be6-4a7f-ae97-b125ff3a73fc] Going to try to terminate instance {{(pid=116098) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:07:40.023992 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-baef81ac-5b98-4fe9-96bf-00c5a045b70d tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] 10.222.0.57 "DELETE /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc" status: 204 len: 0 microversion: 2.1 time: 0.155946 Dec 15 13:07:40.024474 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 426/783] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Dec 15 13:07:39 2021] DELETE /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 13:07:40.035468 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-9ff01f1c-3ad5-43c0-828f-375d0e84731f tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:40.036360 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-9ff01f1c-3ad5-43c0-828f-375d0e84731f tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] [instance: 68f4f473-3be6-4a7f-ae97-b125ff3a73fc] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:40.045511 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9ff01f1c-3ad5-43c0-828f-375d0e84731f tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:40.046805 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9ff01f1c-3ad5-43c0-828f-375d0e84731f tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:40.051285 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9ff01f1c-3ad5-43c0-828f-375d0e84731f tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:40.051869 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9ff01f1c-3ad5-43c0-828f-375d0e84731f tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:40.244478 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c5e02fb8-e9bf-40e3-a6ab-fc078eabb282 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:40.247308 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c5e02fb8-e9bf-40e3-a6ab-fc078eabb282 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: e5b657b8-e2d6-4365-b369-0accd054202d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:40.257464 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c5e02fb8-e9bf-40e3-a6ab-fc078eabb282 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:40.257928 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c5e02fb8-e9bf-40e3-a6ab-fc078eabb282 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:40.258745 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c5e02fb8-e9bf-40e3-a6ab-fc078eabb282 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:40.259172 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c5e02fb8-e9bf-40e3-a6ab-fc078eabb282 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:40.280079 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-9ff01f1c-3ad5-43c0-828f-375d0e84731f tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d477d0eafb8448296405640b334d715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d936046d064508ba41edf0024c46e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:40.291117 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-9ff01f1c-3ad5-43c0-828f-375d0e84731f tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] 10.222.0.57 "GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc" status: 200 len: 1470 microversion: 2.1 time: 0.261064 Dec 15 13:07:40.301788 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 358/784] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:40 2021] GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc => generated 1470 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:40.306118 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-c5e02fb8-e9bf-40e3-a6ab-fc078eabb282 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] HTTP exception thrown: Instance e5b657b8-e2d6-4365-b369-0accd054202d could not be found. Dec 15 13:07:40.307528 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c5e02fb8-e9bf-40e3-a6ab-fc078eabb282 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Returning 404 to user: Instance e5b657b8-e2d6-4365-b369-0accd054202d could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:07:40.308749 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c5e02fb8-e9bf-40e3-a6ab-fc078eabb282 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d" status: 404 len: 111 microversion: 2.1 time: 0.068909 Dec 15 13:07:40.309622 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 427/785] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:40 2021] GET /compute/v2.1/servers/e5b657b8-e2d6-4365-b369-0accd054202d => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 13:07:40.318562 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-d324bbfc-fae3-4594-9290-5854dd9ca078 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:40.319335 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-d324bbfc-fae3-4594-9290-5854dd9ca078 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: c88af1c7-5239-4287-833a-fddf3ae94e88] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:40.327825 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d324bbfc-fae3-4594-9290-5854dd9ca078 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:40.328570 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d324bbfc-fae3-4594-9290-5854dd9ca078 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:40.329600 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d324bbfc-fae3-4594-9290-5854dd9ca078 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:40.330166 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d324bbfc-fae3-4594-9290-5854dd9ca078 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:40.361553 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-d324bbfc-fae3-4594-9290-5854dd9ca078 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: c88af1c7-5239-4287-833a-fddf3ae94e88] Going to try to terminate instance {{(pid=116097) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:07:40.457988 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-d324bbfc-fae3-4594-9290-5854dd9ca078 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88" status: 204 len: 0 microversion: 2.1 time: 0.143517 Dec 15 13:07:40.459543 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 359/786] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Dec 15 13:07:40 2021] DELETE /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:07:40.467980 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-60b60132-a3b3-4f0e-9ec1-4ba6d8df2bd9 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:40.468802 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-60b60132-a3b3-4f0e-9ec1-4ba6d8df2bd9 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: c88af1c7-5239-4287-833a-fddf3ae94e88] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:40.476111 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-60b60132-a3b3-4f0e-9ec1-4ba6d8df2bd9 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:40.476556 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-60b60132-a3b3-4f0e-9ec1-4ba6d8df2bd9 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:40.477329 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-60b60132-a3b3-4f0e-9ec1-4ba6d8df2bd9 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:40.477753 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-60b60132-a3b3-4f0e-9ec1-4ba6d8df2bd9 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:40.625493 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-60b60132-a3b3-4f0e-9ec1-4ba6d8df2bd9 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:40.631953 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-2c5e583b-6494-4b98-9aec-e48e3ee525a0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:40.632663 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-2c5e583b-6494-4b98-9aec-e48e3ee525a0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:40.636657 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-60b60132-a3b3-4f0e-9ec1-4ba6d8df2bd9 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88" status: 200 len: 1513 microversion: 2.1 time: 0.172387 Dec 15 13:07:40.637232 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 428/787] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:40 2021] GET /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88 => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:40.639066 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2c5e583b-6494-4b98-9aec-e48e3ee525a0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:40.639513 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2c5e583b-6494-4b98-9aec-e48e3ee525a0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:40.640293 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2c5e583b-6494-4b98-9aec-e48e3ee525a0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:40.641041 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2c5e583b-6494-4b98-9aec-e48e3ee525a0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:40.778322 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-2c5e583b-6494-4b98-9aec-e48e3ee525a0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:40.786238 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-2c5e583b-6494-4b98-9aec-e48e3ee525a0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.165817 Dec 15 13:07:40.795587 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 360/788] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:40 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:41.309220 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c9f87dd8-885e-47b7-b19f-5218edc63abe tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:41.309820 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c9f87dd8-885e-47b7-b19f-5218edc63abe tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] [instance: 68f4f473-3be6-4a7f-ae97-b125ff3a73fc] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:41.315837 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c9f87dd8-885e-47b7-b19f-5218edc63abe tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:41.316225 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c9f87dd8-885e-47b7-b19f-5218edc63abe tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:41.316995 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c9f87dd8-885e-47b7-b19f-5218edc63abe tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:41.317428 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c9f87dd8-885e-47b7-b19f-5218edc63abe tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:41.460841 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c9f87dd8-885e-47b7-b19f-5218edc63abe tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d477d0eafb8448296405640b334d715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d936046d064508ba41edf0024c46e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:41.468970 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c9f87dd8-885e-47b7-b19f-5218edc63abe tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] 10.222.0.57 "GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc" status: 200 len: 1470 microversion: 2.1 time: 0.163893 Dec 15 13:07:41.469740 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 429/789] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:41 2021] GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:41.654748 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-5be6a9f7-421b-423a-ad78-39b57698b391 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:41.655364 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-5be6a9f7-421b-423a-ad78-39b57698b391 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: c88af1c7-5239-4287-833a-fddf3ae94e88] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:41.661781 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5be6a9f7-421b-423a-ad78-39b57698b391 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:41.662262 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5be6a9f7-421b-423a-ad78-39b57698b391 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:41.663067 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5be6a9f7-421b-423a-ad78-39b57698b391 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:41.663506 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5be6a9f7-421b-423a-ad78-39b57698b391 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:41.803041 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-5be6a9f7-421b-423a-ad78-39b57698b391 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:41.807703 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-99985b77-0028-435f-a0b7-e36d9805e512 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:41.809728 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-99985b77-0028-435f-a0b7-e36d9805e512 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:41.817731 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-99985b77-0028-435f-a0b7-e36d9805e512 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:41.818344 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-99985b77-0028-435f-a0b7-e36d9805e512 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:41.818953 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-5be6a9f7-421b-423a-ad78-39b57698b391 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88" status: 200 len: 1513 microversion: 2.1 time: 0.168312 Dec 15 13:07:41.819252 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-99985b77-0028-435f-a0b7-e36d9805e512 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:41.819790 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-99985b77-0028-435f-a0b7-e36d9805e512 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:41.820327 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 361/790] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:41 2021] GET /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:41.957995 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-99985b77-0028-435f-a0b7-e36d9805e512 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:41.968085 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-99985b77-0028-435f-a0b7-e36d9805e512 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.169125 Dec 15 13:07:41.968817 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 430/791] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:41 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:42.490724 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-d0a60fa8-4f2b-48da-9490-3b8b9add34a8 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:42.491371 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-d0a60fa8-4f2b-48da-9490-3b8b9add34a8 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] [instance: 68f4f473-3be6-4a7f-ae97-b125ff3a73fc] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:42.501095 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d0a60fa8-4f2b-48da-9490-3b8b9add34a8 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:42.502069 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d0a60fa8-4f2b-48da-9490-3b8b9add34a8 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:42.503278 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d0a60fa8-4f2b-48da-9490-3b8b9add34a8 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:42.504451 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d0a60fa8-4f2b-48da-9490-3b8b9add34a8 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:42.676330 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-d0a60fa8-4f2b-48da-9490-3b8b9add34a8 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d477d0eafb8448296405640b334d715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d936046d064508ba41edf0024c46e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:42.686398 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-d0a60fa8-4f2b-48da-9490-3b8b9add34a8 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] 10.222.0.57 "GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc" status: 200 len: 1470 microversion: 2.1 time: 0.199842 Dec 15 13:07:42.686985 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 362/792] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:42 2021] GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc => generated 1470 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:42.837910 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-88033baa-9492-4c93-8222-84a59627972b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:42.840889 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-88033baa-9492-4c93-8222-84a59627972b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: c88af1c7-5239-4287-833a-fddf3ae94e88] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:42.847714 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-88033baa-9492-4c93-8222-84a59627972b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:42.848159 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-88033baa-9492-4c93-8222-84a59627972b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:42.849130 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-88033baa-9492-4c93-8222-84a59627972b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:42.849564 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-88033baa-9492-4c93-8222-84a59627972b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:42.985468 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-5affa18a-e164-4102-a89c-c940ea6dfe3f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:42.986072 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-5affa18a-e164-4102-a89c-c940ea6dfe3f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:42.992582 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5affa18a-e164-4102-a89c-c940ea6dfe3f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:42.993165 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5affa18a-e164-4102-a89c-c940ea6dfe3f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:42.994056 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5affa18a-e164-4102-a89c-c940ea6dfe3f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:42.994846 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5affa18a-e164-4102-a89c-c940ea6dfe3f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:42.997572 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-88033baa-9492-4c93-8222-84a59627972b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:43.006108 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-88033baa-9492-4c93-8222-84a59627972b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88" status: 200 len: 1513 microversion: 2.1 time: 0.172842 Dec 15 13:07:43.009285 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 431/793] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:42 2021] GET /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88 => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:43.143019 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-5affa18a-e164-4102-a89c-c940ea6dfe3f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:43.151111 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-5affa18a-e164-4102-a89c-c940ea6dfe3f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.169199 Dec 15 13:07:43.162044 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 363/794] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:42 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:43.707272 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-134dd2dc-e291-4757-b842-486e613cd517 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:43.708140 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-134dd2dc-e291-4757-b842-486e613cd517 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] [instance: 68f4f473-3be6-4a7f-ae97-b125ff3a73fc] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:43.715810 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-134dd2dc-e291-4757-b842-486e613cd517 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:43.716284 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-134dd2dc-e291-4757-b842-486e613cd517 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:43.717843 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-134dd2dc-e291-4757-b842-486e613cd517 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:43.718327 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-134dd2dc-e291-4757-b842-486e613cd517 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:43.731904 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-2261aef1-ed47-4f0f-9c37-dbb37b0e0c27 req-08bf6b86-0dd6-4fea-bec6-acafbaaa4636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f4f473-3be6-4a7f-ae97-b125ff3a73fc", "name": "network-vif-deleted", "tag": "58ae3c4f-f2b1-4ff8-b5b6-e2fb549417d3"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:07:43.733521 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:07:43.733521 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:07:43.769909 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-2261aef1-ed47-4f0f-9c37-dbb37b0e0c27 req-08bf6b86-0dd6-4fea-bec6-acafbaaa4636 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:43.771984 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-2261aef1-ed47-4f0f-9c37-dbb37b0e0c27 req-08bf6b86-0dd6-4fea-bec6-acafbaaa4636 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:43.816139 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-2261aef1-ed47-4f0f-9c37-dbb37b0e0c27 req-08bf6b86-0dd6-4fea-bec6-acafbaaa4636 service nova] Creating event network-vif-deleted:58ae3c4f-f2b1-4ff8-b5b6-e2fb549417d3 for instance 68f4f473-3be6-4a7f-ae97-b125ff3a73fc on hv-cinder-81322 Dec 15 13:07:43.828639 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-2261aef1-ed47-4f0f-9c37-dbb37b0e0c27 req-08bf6b86-0dd6-4fea-bec6-acafbaaa4636 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100457 Dec 15 13:07:43.829985 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 364/795] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:07:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:07:43.897233 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-134dd2dc-e291-4757-b842-486e613cd517 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d477d0eafb8448296405640b334d715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d936046d064508ba41edf0024c46e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:43.909080 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-134dd2dc-e291-4757-b842-486e613cd517 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] 10.222.0.57 "GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc" status: 200 len: 1428 microversion: 2.1 time: 0.207180 Dec 15 13:07:43.909799 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 432/796] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:43 2021] GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc => generated 1428 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:44.028361 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-ce274f13-4ee2-4da8-96ba-ed5e8675d328 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:44.029513 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-ce274f13-4ee2-4da8-96ba-ed5e8675d328 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: c88af1c7-5239-4287-833a-fddf3ae94e88] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:44.040072 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ce274f13-4ee2-4da8-96ba-ed5e8675d328 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:44.041171 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ce274f13-4ee2-4da8-96ba-ed5e8675d328 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:44.042831 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ce274f13-4ee2-4da8-96ba-ed5e8675d328 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:44.043674 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ce274f13-4ee2-4da8-96ba-ed5e8675d328 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:44.171113 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-cde8cda2-8c31-41f0-a47d-40b84a96ac2a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:44.171749 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-cde8cda2-8c31-41f0-a47d-40b84a96ac2a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:44.185899 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cde8cda2-8c31-41f0-a47d-40b84a96ac2a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:44.192527 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cde8cda2-8c31-41f0-a47d-40b84a96ac2a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:44.193644 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cde8cda2-8c31-41f0-a47d-40b84a96ac2a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:44.194926 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cde8cda2-8c31-41f0-a47d-40b84a96ac2a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:44.208174 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-ce274f13-4ee2-4da8-96ba-ed5e8675d328 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:44.217514 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-ce274f13-4ee2-4da8-96ba-ed5e8675d328 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88" status: 200 len: 1513 microversion: 2.1 time: 0.195142 Dec 15 13:07:44.219044 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 365/797] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:44 2021] GET /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88 => generated 1513 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:44.357914 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-1dcb06bd-c3ed-4e10-82c3-b05c2b2d6996 req-4af9b1a6-3e6d-4092-93c2-95d2f65b08ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c88af1c7-5239-4287-833a-fddf3ae94e88", "name": "network-vif-deleted", "tag": "47ca2e9d-4ba0-47a6-a133-ed51c6693aa3"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:07:44.360505 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:07:44.360505 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:07:44.369749 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-1dcb06bd-c3ed-4e10-82c3-b05c2b2d6996 req-4af9b1a6-3e6d-4092-93c2-95d2f65b08ee service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:44.370260 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-1dcb06bd-c3ed-4e10-82c3-b05c2b2d6996 req-4af9b1a6-3e6d-4092-93c2-95d2f65b08ee service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:44.389710 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-1dcb06bd-c3ed-4e10-82c3-b05c2b2d6996 req-4af9b1a6-3e6d-4092-93c2-95d2f65b08ee service nova] Creating event network-vif-deleted:47ca2e9d-4ba0-47a6-a133-ed51c6693aa3 for instance c88af1c7-5239-4287-833a-fddf3ae94e88 on hv-cinder-81322 Dec 15 13:07:44.395946 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-1dcb06bd-c3ed-4e10-82c3-b05c2b2d6996 req-4af9b1a6-3e6d-4092-93c2-95d2f65b08ee service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044701 Dec 15 13:07:44.396889 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 366/798] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:07:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:07:44.443915 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-cde8cda2-8c31-41f0-a47d-40b84a96ac2a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:44.452444 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-cde8cda2-8c31-41f0-a47d-40b84a96ac2a tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.287314 Dec 15 13:07:44.453135 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 433/799] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:44 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:44.929103 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-cf71caf6-5d81-4ce4-8ba0-031c18815bac tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:44.929781 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-cf71caf6-5d81-4ce4-8ba0-031c18815bac tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] [instance: 68f4f473-3be6-4a7f-ae97-b125ff3a73fc] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:44.935765 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cf71caf6-5d81-4ce4-8ba0-031c18815bac tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:44.936210 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cf71caf6-5d81-4ce4-8ba0-031c18815bac tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:44.936971 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cf71caf6-5d81-4ce4-8ba0-031c18815bac tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:44.937432 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cf71caf6-5d81-4ce4-8ba0-031c18815bac tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:44.967180 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cf71caf6-5d81-4ce4-8ba0-031c18815bac tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:44.967552 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cf71caf6-5d81-4ce4-8ba0-031c18815bac tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:44.967988 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.objects.instance [None req-cf71caf6-5d81-4ce4-8ba0-031c18815bac tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lazy-loading 'fault' on Instance uuid 68f4f473-3be6-4a7f-ae97-b125ff3a73fc {{(pid=116097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:07:45.005531 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-cf71caf6-5d81-4ce4-8ba0-031c18815bac tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d477d0eafb8448296405640b334d715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d936046d064508ba41edf0024c46e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:45.013135 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-cf71caf6-5d81-4ce4-8ba0-031c18815bac tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] 10.222.0.57 "GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc" status: 200 len: 1305 microversion: 2.1 time: 0.088420 Dec 15 13:07:45.013693 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 367/800] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:44 2021] GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc => generated 1305 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:45.235054 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-397d79e8-a427-464b-82ab-fa5caf84b591 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:45.235668 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-397d79e8-a427-464b-82ab-fa5caf84b591 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: c88af1c7-5239-4287-833a-fddf3ae94e88] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:45.242179 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-397d79e8-a427-464b-82ab-fa5caf84b591 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:45.242921 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-397d79e8-a427-464b-82ab-fa5caf84b591 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:45.243763 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-397d79e8-a427-464b-82ab-fa5caf84b591 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:45.244198 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-397d79e8-a427-464b-82ab-fa5caf84b591 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:45.305997 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-397d79e8-a427-464b-82ab-fa5caf84b591 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:45.313697 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-397d79e8-a427-464b-82ab-fa5caf84b591 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88" status: 200 len: 1471 microversion: 2.1 time: 0.082506 Dec 15 13:07:45.314269 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 434/801] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:45 2021] GET /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88 => generated 1471 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:45.469161 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-0f1141a0-bf44-4c2f-ac5c-c0cd5d388829 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:45.469797 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-0f1141a0-bf44-4c2f-ac5c-c0cd5d388829 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:45.475626 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0f1141a0-bf44-4c2f-ac5c-c0cd5d388829 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:45.476019 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0f1141a0-bf44-4c2f-ac5c-c0cd5d388829 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:45.476817 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0f1141a0-bf44-4c2f-ac5c-c0cd5d388829 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:45.477264 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0f1141a0-bf44-4c2f-ac5c-c0cd5d388829 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:45.607233 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-0f1141a0-bf44-4c2f-ac5c-c0cd5d388829 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:45.614820 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-0f1141a0-bf44-4c2f-ac5c-c0cd5d388829 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.149283 Dec 15 13:07:45.615381 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 368/802] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:45 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:46.031470 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-37690e4c-92a0-4e29-a14e-0dce7bcd9185 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:46.032096 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-37690e4c-92a0-4e29-a14e-0dce7bcd9185 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] [instance: 68f4f473-3be6-4a7f-ae97-b125ff3a73fc] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:46.037962 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-37690e4c-92a0-4e29-a14e-0dce7bcd9185 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:46.038526 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-37690e4c-92a0-4e29-a14e-0dce7bcd9185 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:46.039294 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-37690e4c-92a0-4e29-a14e-0dce7bcd9185 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:46.039724 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-37690e4c-92a0-4e29-a14e-0dce7bcd9185 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:46.068814 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-37690e4c-92a0-4e29-a14e-0dce7bcd9185 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:46.069184 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-37690e4c-92a0-4e29-a14e-0dce7bcd9185 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:46.069624 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.objects.instance [None req-37690e4c-92a0-4e29-a14e-0dce7bcd9185 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lazy-loading 'fault' on Instance uuid 68f4f473-3be6-4a7f-ae97-b125ff3a73fc {{(pid=116098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:07:46.107582 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-37690e4c-92a0-4e29-a14e-0dce7bcd9185 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d477d0eafb8448296405640b334d715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d936046d064508ba41edf0024c46e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:46.114788 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-37690e4c-92a0-4e29-a14e-0dce7bcd9185 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] 10.222.0.57 "GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc" status: 200 len: 1305 microversion: 2.1 time: 0.087028 Dec 15 13:07:46.115349 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 435/803] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:46 2021] GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc => generated 1305 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:46.330104 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-6e109f76-facb-4f6f-b5de-31e4a5f59777 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:46.330755 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-6e109f76-facb-4f6f-b5de-31e4a5f59777 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: c88af1c7-5239-4287-833a-fddf3ae94e88] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:46.336917 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6e109f76-facb-4f6f-b5de-31e4a5f59777 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:46.337369 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6e109f76-facb-4f6f-b5de-31e4a5f59777 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:46.338168 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6e109f76-facb-4f6f-b5de-31e4a5f59777 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:46.339280 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6e109f76-facb-4f6f-b5de-31e4a5f59777 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:46.397168 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-6e109f76-facb-4f6f-b5de-31e4a5f59777 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:46.404940 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-6e109f76-facb-4f6f-b5de-31e4a5f59777 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88" status: 200 len: 1471 microversion: 2.1 time: 0.078515 Dec 15 13:07:46.405547 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 369/804] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:46 2021] GET /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88 => generated 1471 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:46.631816 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a01d466b-8e75-41f2-ad33-7a15f9236d57 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:46.632450 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a01d466b-8e75-41f2-ad33-7a15f9236d57 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:46.639277 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a01d466b-8e75-41f2-ad33-7a15f9236d57 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:46.639722 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a01d466b-8e75-41f2-ad33-7a15f9236d57 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:46.640492 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a01d466b-8e75-41f2-ad33-7a15f9236d57 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:46.641174 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a01d466b-8e75-41f2-ad33-7a15f9236d57 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:46.770585 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a01d466b-8e75-41f2-ad33-7a15f9236d57 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:46.778096 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a01d466b-8e75-41f2-ad33-7a15f9236d57 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.149866 Dec 15 13:07:46.778676 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 436/805] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:46 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:47.131510 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-c6f6fadc-f2e7-4e63-bbcb-8c60c0e67072 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:47.132121 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-c6f6fadc-f2e7-4e63-bbcb-8c60c0e67072 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] [instance: 68f4f473-3be6-4a7f-ae97-b125ff3a73fc] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:47.137921 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c6f6fadc-f2e7-4e63-bbcb-8c60c0e67072 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:47.138402 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c6f6fadc-f2e7-4e63-bbcb-8c60c0e67072 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:47.139175 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c6f6fadc-f2e7-4e63-bbcb-8c60c0e67072 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:47.139608 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c6f6fadc-f2e7-4e63-bbcb-8c60c0e67072 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:47.168813 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c6f6fadc-f2e7-4e63-bbcb-8c60c0e67072 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:47.169258 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c6f6fadc-f2e7-4e63-bbcb-8c60c0e67072 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:47.169700 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.objects.instance [None req-c6f6fadc-f2e7-4e63-bbcb-8c60c0e67072 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lazy-loading 'fault' on Instance uuid 68f4f473-3be6-4a7f-ae97-b125ff3a73fc {{(pid=116097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:07:47.208525 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-c6f6fadc-f2e7-4e63-bbcb-8c60c0e67072 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d477d0eafb8448296405640b334d715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d936046d064508ba41edf0024c46e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:47.215761 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-c6f6fadc-f2e7-4e63-bbcb-8c60c0e67072 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] 10.222.0.57 "GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc" status: 200 len: 1305 microversion: 2.1 time: 0.087872 Dec 15 13:07:47.216324 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 370/806] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:47 2021] GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc => generated 1305 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:47.420691 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b6738f83-da93-4dce-a951-107e482605aa tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:47.421238 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b6738f83-da93-4dce-a951-107e482605aa tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: c88af1c7-5239-4287-833a-fddf3ae94e88] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:47.426927 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b6738f83-da93-4dce-a951-107e482605aa tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:47.427367 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b6738f83-da93-4dce-a951-107e482605aa tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:47.428174 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b6738f83-da93-4dce-a951-107e482605aa tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:47.428553 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b6738f83-da93-4dce-a951-107e482605aa tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:47.458856 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b6738f83-da93-4dce-a951-107e482605aa tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:47.459302 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b6738f83-da93-4dce-a951-107e482605aa tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:47.459737 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.objects.instance [None req-b6738f83-da93-4dce-a951-107e482605aa tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lazy-loading 'fault' on Instance uuid c88af1c7-5239-4287-833a-fddf3ae94e88 {{(pid=116098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:07:47.496804 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b6738f83-da93-4dce-a951-107e482605aa tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:47.503792 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b6738f83-da93-4dce-a951-107e482605aa tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88" status: 200 len: 1307 microversion: 2.1 time: 0.086929 Dec 15 13:07:47.504348 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 437/807] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:47 2021] GET /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88 => generated 1307 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:47.795319 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-584e8aaa-a4cc-4915-b958-01df87457356 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:47.795846 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-584e8aaa-a4cc-4915-b958-01df87457356 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:47.802119 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-584e8aaa-a4cc-4915-b958-01df87457356 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:47.802601 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-584e8aaa-a4cc-4915-b958-01df87457356 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:47.803376 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-584e8aaa-a4cc-4915-b958-01df87457356 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:47.803811 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-584e8aaa-a4cc-4915-b958-01df87457356 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:47.947489 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-584e8aaa-a4cc-4915-b958-01df87457356 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:47.955219 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-584e8aaa-a4cc-4915-b958-01df87457356 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.164052 Dec 15 13:07:47.955793 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 371/808] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:47 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:48.233437 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-03d8df90-c7f6-46e7-bd1d-fd0dc6a3a2e8 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:48.234515 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-03d8df90-c7f6-46e7-bd1d-fd0dc6a3a2e8 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] [instance: 68f4f473-3be6-4a7f-ae97-b125ff3a73fc] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:48.243412 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-03d8df90-c7f6-46e7-bd1d-fd0dc6a3a2e8 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:48.243971 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-03d8df90-c7f6-46e7-bd1d-fd0dc6a3a2e8 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:48.245166 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-03d8df90-c7f6-46e7-bd1d-fd0dc6a3a2e8 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:48.245670 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-03d8df90-c7f6-46e7-bd1d-fd0dc6a3a2e8 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:48.260346 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-03d8df90-c7f6-46e7-bd1d-fd0dc6a3a2e8 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] HTTP exception thrown: Instance 68f4f473-3be6-4a7f-ae97-b125ff3a73fc could not be found. Dec 15 13:07:48.260918 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-03d8df90-c7f6-46e7-bd1d-fd0dc6a3a2e8 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] Returning 404 to user: Instance 68f4f473-3be6-4a7f-ae97-b125ff3a73fc could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:07:48.261723 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-03d8df90-c7f6-46e7-bd1d-fd0dc6a3a2e8 tempest-VolumesNegativeTest-369880389 tempest-VolumesNegativeTest-369880389-project] 10.222.0.57 "GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc" status: 404 len: 111 microversion: 2.1 time: 0.033510 Dec 15 13:07:48.262274 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 438/809] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:48 2021] GET /compute/v2.1/servers/68f4f473-3be6-4a7f-ae97-b125ff3a73fc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:07:48.523115 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-57a14ee2-7e76-451c-83c7-2eb4e93a4a83 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:48.523915 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-57a14ee2-7e76-451c-83c7-2eb4e93a4a83 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: c88af1c7-5239-4287-833a-fddf3ae94e88] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:48.531016 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-57a14ee2-7e76-451c-83c7-2eb4e93a4a83 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:48.531721 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-57a14ee2-7e76-451c-83c7-2eb4e93a4a83 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:48.532585 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-57a14ee2-7e76-451c-83c7-2eb4e93a4a83 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:48.532996 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-57a14ee2-7e76-451c-83c7-2eb4e93a4a83 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:48.549998 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.wsgi [None req-57a14ee2-7e76-451c-83c7-2eb4e93a4a83 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] HTTP exception thrown: Instance c88af1c7-5239-4287-833a-fddf3ae94e88 could not be found. Dec 15 13:07:48.550621 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-57a14ee2-7e76-451c-83c7-2eb4e93a4a83 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Returning 404 to user: Instance c88af1c7-5239-4287-833a-fddf3ae94e88 could not be found. {{(pid=116097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:07:48.551458 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-57a14ee2-7e76-451c-83c7-2eb4e93a4a83 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88" status: 404 len: 111 microversion: 2.1 time: 0.032274 Dec 15 13:07:48.555151 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 372/810] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:48 2021] GET /compute/v2.1/servers/c88af1c7-5239-4287-833a-fddf3ae94e88 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:07:48.972065 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d66c8eba-8411-44f9-97af-7cb7a643ab8e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:48.972672 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d66c8eba-8411-44f9-97af-7cb7a643ab8e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:48.979016 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d66c8eba-8411-44f9-97af-7cb7a643ab8e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:48.979855 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d66c8eba-8411-44f9-97af-7cb7a643ab8e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:48.980366 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d66c8eba-8411-44f9-97af-7cb7a643ab8e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:48.980826 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d66c8eba-8411-44f9-97af-7cb7a643ab8e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:49.136564 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d66c8eba-8411-44f9-97af-7cb7a643ab8e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:49.153320 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d66c8eba-8411-44f9-97af-7cb7a643ab8e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.184681 Dec 15 13:07:49.154037 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 439/811] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:48 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:49.702412 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-ebbe2c2e-571d-4205-857f-1ad6de701cb1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:49.702914 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-ebbe2c2e-571d-4205-857f-1ad6de701cb1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:49.709061 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ebbe2c2e-571d-4205-857f-1ad6de701cb1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:49.709513 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ebbe2c2e-571d-4205-857f-1ad6de701cb1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:49.710324 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ebbe2c2e-571d-4205-857f-1ad6de701cb1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:49.710766 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ebbe2c2e-571d-4205-857f-1ad6de701cb1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:49.736236 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-ebbe2c2e-571d-4205-857f-1ad6de701cb1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Going to try to terminate instance {{(pid=116097) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:07:49.817770 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-ebbe2c2e-571d-4205-857f-1ad6de701cb1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "DELETE /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 204 len: 0 microversion: 2.1 time: 0.118584 Dec 15 13:07:49.818423 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 373/812] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Dec 15 13:07:49 2021] DELETE /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:07:49.828469 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-914e31a5-4577-4af1-95cb-edf19bee0e8b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:49.829749 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-914e31a5-4577-4af1-95cb-edf19bee0e8b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:49.835753 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-914e31a5-4577-4af1-95cb-edf19bee0e8b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:49.836735 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-914e31a5-4577-4af1-95cb-edf19bee0e8b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:49.837162 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-914e31a5-4577-4af1-95cb-edf19bee0e8b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:49.837631 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-914e31a5-4577-4af1-95cb-edf19bee0e8b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:49.982021 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-914e31a5-4577-4af1-95cb-edf19bee0e8b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:49.989685 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-914e31a5-4577-4af1-95cb-edf19bee0e8b tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 200 len: 1513 microversion: 2.1 time: 0.166341 Dec 15 13:07:49.990269 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 440/813] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:49 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:50.171178 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-f99b6718-7d80-4319-9b1d-3ea5bf962ddc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:50.171869 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-f99b6718-7d80-4319-9b1d-3ea5bf962ddc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:50.177781 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f99b6718-7d80-4319-9b1d-3ea5bf962ddc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:50.178274 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f99b6718-7d80-4319-9b1d-3ea5bf962ddc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:50.179229 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f99b6718-7d80-4319-9b1d-3ea5bf962ddc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:50.180057 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f99b6718-7d80-4319-9b1d-3ea5bf962ddc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:50.322469 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-f99b6718-7d80-4319-9b1d-3ea5bf962ddc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:50.331624 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-f99b6718-7d80-4319-9b1d-3ea5bf962ddc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.164424 Dec 15 13:07:50.332195 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 374/814] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:50 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:51.006943 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b84dca8d-c612-488f-a737-5dffa1d1d0f1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:51.007546 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b84dca8d-c612-488f-a737-5dffa1d1d0f1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:51.014005 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b84dca8d-c612-488f-a737-5dffa1d1d0f1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:51.014485 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b84dca8d-c612-488f-a737-5dffa1d1d0f1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:51.015314 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b84dca8d-c612-488f-a737-5dffa1d1d0f1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:51.015937 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b84dca8d-c612-488f-a737-5dffa1d1d0f1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:51.152360 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b84dca8d-c612-488f-a737-5dffa1d1d0f1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:51.159844 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b84dca8d-c612-488f-a737-5dffa1d1d0f1 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 200 len: 1513 microversion: 2.1 time: 0.156477 Dec 15 13:07:51.160512 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 441/815] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:51 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:51.348520 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-534ccd5a-ff66-49ab-9fdd-93829f9f60f1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:51.349039 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-534ccd5a-ff66-49ab-9fdd-93829f9f60f1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:51.356024 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-534ccd5a-ff66-49ab-9fdd-93829f9f60f1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:51.356479 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-534ccd5a-ff66-49ab-9fdd-93829f9f60f1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:51.357458 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-534ccd5a-ff66-49ab-9fdd-93829f9f60f1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:51.357897 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-534ccd5a-ff66-49ab-9fdd-93829f9f60f1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:51.485327 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-534ccd5a-ff66-49ab-9fdd-93829f9f60f1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:51.493238 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-534ccd5a-ff66-49ab-9fdd-93829f9f60f1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.148467 Dec 15 13:07:51.493799 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 375/816] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:51 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:52.176373 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a190044c-27e7-429b-93d1-41b4a5ce0605 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:52.176973 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a190044c-27e7-429b-93d1-41b4a5ce0605 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:52.183779 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a190044c-27e7-429b-93d1-41b4a5ce0605 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:52.184225 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a190044c-27e7-429b-93d1-41b4a5ce0605 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:52.185050 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a190044c-27e7-429b-93d1-41b4a5ce0605 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:52.185457 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a190044c-27e7-429b-93d1-41b4a5ce0605 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:52.321595 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a190044c-27e7-429b-93d1-41b4a5ce0605 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:52.328953 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a190044c-27e7-429b-93d1-41b4a5ce0605 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 200 len: 1513 microversion: 2.1 time: 0.156219 Dec 15 13:07:52.329507 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 442/817] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:52 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:52.510850 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-1b8f632b-095c-41e3-88f8-9100fef267da tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:52.511417 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-1b8f632b-095c-41e3-88f8-9100fef267da tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:52.517966 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1b8f632b-095c-41e3-88f8-9100fef267da tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:52.518449 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1b8f632b-095c-41e3-88f8-9100fef267da tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:52.519234 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1b8f632b-095c-41e3-88f8-9100fef267da tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:52.519668 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1b8f632b-095c-41e3-88f8-9100fef267da tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:52.670326 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-1b8f632b-095c-41e3-88f8-9100fef267da tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:52.678008 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-1b8f632b-095c-41e3-88f8-9100fef267da tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.171204 Dec 15 13:07:52.678606 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 376/818] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:52 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:53.346170 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a8c44936-7740-404a-b39d-248162ec0490 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:53.346939 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a8c44936-7740-404a-b39d-248162ec0490 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:53.353320 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a8c44936-7740-404a-b39d-248162ec0490 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:53.353897 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a8c44936-7740-404a-b39d-248162ec0490 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:53.354816 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a8c44936-7740-404a-b39d-248162ec0490 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:53.355349 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a8c44936-7740-404a-b39d-248162ec0490 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:53.546559 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a8c44936-7740-404a-b39d-248162ec0490 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:53.555021 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a8c44936-7740-404a-b39d-248162ec0490 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 200 len: 1513 microversion: 2.1 time: 0.212617 Dec 15 13:07:53.571480 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 443/819] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:53 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 1513 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:53.706859 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-9db5f04c-d523-4796-b7dd-2dd2312685bc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:53.708268 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-9db5f04c-d523-4796-b7dd-2dd2312685bc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:53.715399 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9db5f04c-d523-4796-b7dd-2dd2312685bc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:53.715858 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9db5f04c-d523-4796-b7dd-2dd2312685bc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:53.716657 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9db5f04c-d523-4796-b7dd-2dd2312685bc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:53.717090 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9db5f04c-d523-4796-b7dd-2dd2312685bc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:53.896822 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-9db5f04c-d523-4796-b7dd-2dd2312685bc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:53.905167 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-9db5f04c-d523-4796-b7dd-2dd2312685bc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.202704 Dec 15 13:07:53.905806 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 377/820] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:53 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:54.575186 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c0bcc852-f301-4577-b340-02f5e889fee8 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:54.576064 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c0bcc852-f301-4577-b340-02f5e889fee8 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:54.582692 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c0bcc852-f301-4577-b340-02f5e889fee8 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:54.583225 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c0bcc852-f301-4577-b340-02f5e889fee8 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:54.584101 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c0bcc852-f301-4577-b340-02f5e889fee8 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:54.585846 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c0bcc852-f301-4577-b340-02f5e889fee8 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:54.799539 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c0bcc852-f301-4577-b340-02f5e889fee8 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:54.822676 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c0bcc852-f301-4577-b340-02f5e889fee8 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 200 len: 1513 microversion: 2.1 time: 0.251737 Dec 15 13:07:54.823263 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 444/821] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:54 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 1513 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:54.922531 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-8f51800c-450a-4e82-b558-8edec292271b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:54.923330 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-8f51800c-450a-4e82-b558-8edec292271b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:54.928869 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8f51800c-450a-4e82-b558-8edec292271b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:54.929314 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8f51800c-450a-4e82-b558-8edec292271b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:54.930092 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8f51800c-450a-4e82-b558-8edec292271b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:54.930951 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8f51800c-450a-4e82-b558-8edec292271b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:55.082744 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-8f51800c-450a-4e82-b558-8edec292271b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:55.091919 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-8f51800c-450a-4e82-b558-8edec292271b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.172965 Dec 15 13:07:55.092881 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 378/822] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:54 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:55.169757 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-71c2d1af-200c-4f9f-9e0b-6b57a8a7ebb0 req-b988bf72-e2ca-4112-84f2-6ddcb3ea23ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff", "name": "network-vif-deleted", "tag": "5b7da152-6ada-44e9-b82c-2cd8bd9b0213"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:07:55.175682 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:07:55.175682 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:07:55.185414 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-71c2d1af-200c-4f9f-9e0b-6b57a8a7ebb0 req-b988bf72-e2ca-4112-84f2-6ddcb3ea23ba service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:55.186122 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-71c2d1af-200c-4f9f-9e0b-6b57a8a7ebb0 req-b988bf72-e2ca-4112-84f2-6ddcb3ea23ba service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:55.201709 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-71c2d1af-200c-4f9f-9e0b-6b57a8a7ebb0 req-b988bf72-e2ca-4112-84f2-6ddcb3ea23ba service nova] Creating event network-vif-deleted:5b7da152-6ada-44e9-b82c-2cd8bd9b0213 for instance fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff on hv-cinder-81322 Dec 15 13:07:55.206869 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-71c2d1af-200c-4f9f-9e0b-6b57a8a7ebb0 req-b988bf72-e2ca-4112-84f2-6ddcb3ea23ba service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042987 Dec 15 13:07:55.207591 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 445/823] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:07:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:07:55.840482 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-c76a17c8-29d7-46b1-9d38-2c40776eb92c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:55.841101 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-c76a17c8-29d7-46b1-9d38-2c40776eb92c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:55.846865 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c76a17c8-29d7-46b1-9d38-2c40776eb92c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:55.847525 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c76a17c8-29d7-46b1-9d38-2c40776eb92c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:55.848311 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c76a17c8-29d7-46b1-9d38-2c40776eb92c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:55.848743 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c76a17c8-29d7-46b1-9d38-2c40776eb92c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:55.887357 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c76a17c8-29d7-46b1-9d38-2c40776eb92c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:55.887801 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c76a17c8-29d7-46b1-9d38-2c40776eb92c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:55.888254 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.objects.instance [None req-c76a17c8-29d7-46b1-9d38-2c40776eb92c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lazy-loading 'fault' on Instance uuid fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff {{(pid=116097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:07:55.933153 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-c76a17c8-29d7-46b1-9d38-2c40776eb92c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b47404ef24941829d657acb729f93da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e0b910ad794c7db450e6bb1c96cd01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:55.940947 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-c76a17c8-29d7-46b1-9d38-2c40776eb92c tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 200 len: 1307 microversion: 2.1 time: 0.104493 Dec 15 13:07:55.941595 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 379/824] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:55 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 1307 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:56.109551 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f2a9741f-a728-4fc5-bb93-87cf65b19a7d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:56.110261 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f2a9741f-a728-4fc5-bb93-87cf65b19a7d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:56.116726 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f2a9741f-a728-4fc5-bb93-87cf65b19a7d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:56.117170 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f2a9741f-a728-4fc5-bb93-87cf65b19a7d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:56.117944 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f2a9741f-a728-4fc5-bb93-87cf65b19a7d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:56.118422 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f2a9741f-a728-4fc5-bb93-87cf65b19a7d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:56.244705 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-9f63c65e-4c62-4a17-b9eb-bc7dcd4eae52 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:56.245205 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-9f63c65e-4c62-4a17-b9eb-bc7dcd4eae52 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:56.249114 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f2a9741f-a728-4fc5-bb93-87cf65b19a7d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:56.251067 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9f63c65e-4c62-4a17-b9eb-bc7dcd4eae52 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:56.251519 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9f63c65e-4c62-4a17-b9eb-bc7dcd4eae52 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:56.252298 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9f63c65e-4c62-4a17-b9eb-bc7dcd4eae52 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:56.252766 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9f63c65e-4c62-4a17-b9eb-bc7dcd4eae52 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:56.257126 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f2a9741f-a728-4fc5-bb93-87cf65b19a7d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.151923 Dec 15 13:07:56.257688 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 446/825] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:56 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:56.334289 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.objects.instance [None req-9f63c65e-4c62-4a17-b9eb-bc7dcd4eae52 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lazy-loading 'services' on Instance uuid d8be01f4-a176-41ba-b710-1a2fe19b85f5 {{(pid=116097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:07:56.407688 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-9f63c65e-4c62-4a17-b9eb-bc7dcd4eae52 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5/os-volume_attachments/938e9333-70b9-4b2d-9da5-b6af60ba5dca" status: 202 len: 0 microversion: 2.1 time: 0.165583 Dec 15 13:07:56.407688 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 380/826] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Dec 15 13:07:56 2021] DELETE /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5/os-volume_attachments/938e9333-70b9-4b2d-9da5-b6af60ba5dca => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:07:56.958170 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-034c2656-2a00-4db8-9877-d5b021d3b7c0 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:56.958829 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-034c2656-2a00-4db8-9877-d5b021d3b7c0 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] [instance: fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:56.964647 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-034c2656-2a00-4db8-9877-d5b021d3b7c0 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:56.965086 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-034c2656-2a00-4db8-9877-d5b021d3b7c0 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:56.965877 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-034c2656-2a00-4db8-9877-d5b021d3b7c0 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:56.966504 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-034c2656-2a00-4db8-9877-d5b021d3b7c0 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:56.979309 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-034c2656-2a00-4db8-9877-d5b021d3b7c0 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] HTTP exception thrown: Instance fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff could not be found. Dec 15 13:07:56.980407 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-034c2656-2a00-4db8-9877-d5b021d3b7c0 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] Returning 404 to user: Instance fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:07:56.981204 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-034c2656-2a00-4db8-9877-d5b021d3b7c0 tempest-AttachVolumeNegativeTest-169309790 tempest-AttachVolumeNegativeTest-169309790-project] 10.222.0.57 "GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff" status: 404 len: 111 microversion: 2.1 time: 0.026720 Dec 15 13:07:56.981721 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 447/827] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:56 2021] GET /compute/v2.1/servers/fdcb6b47-d0ec-470f-9e19-e8ae57c3a1ff => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:07:57.275118 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-efe541c2-9caf-4b8f-b895-ce3aadfd7818 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:57.275936 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-efe541c2-9caf-4b8f-b895-ce3aadfd7818 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:57.284244 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-efe541c2-9caf-4b8f-b895-ce3aadfd7818 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:57.284859 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-efe541c2-9caf-4b8f-b895-ce3aadfd7818 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:57.285723 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-efe541c2-9caf-4b8f-b895-ce3aadfd7818 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:57.286260 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-efe541c2-9caf-4b8f-b895-ce3aadfd7818 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:57.432817 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-efe541c2-9caf-4b8f-b895-ce3aadfd7818 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:57.441197 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-efe541c2-9caf-4b8f-b895-ce3aadfd7818 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.170388 Dec 15 13:07:57.441963 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 381/828] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:57 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:58.029845 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-70879e83-783b-420a-a837-a07eb673c339 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:07:58.031716 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-70879e83-783b-420a-a837-a07eb673c339 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:58.038489 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-70879e83-783b-420a-a837-a07eb673c339 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:58.038944 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-70879e83-783b-420a-a837-a07eb673c339 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:58.039738 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-70879e83-783b-420a-a837-a07eb673c339 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:58.040175 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-70879e83-783b-420a-a837-a07eb673c339 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:58.113441 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-70879e83-783b-420a-a837-a07eb673c339 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "POST /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e/action" status: 202 len: 0 microversion: 2.1 time: 0.087167 Dec 15 13:07:58.117404 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 448/829] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:07:58 2021] POST /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:07:58.123033 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-d18234fe-79ea-4206-b8f3-66adc94d0602 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:58.123845 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-d18234fe-79ea-4206-b8f3-66adc94d0602 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:58.129685 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d18234fe-79ea-4206-b8f3-66adc94d0602 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:58.130464 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d18234fe-79ea-4206-b8f3-66adc94d0602 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:58.131422 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d18234fe-79ea-4206-b8f3-66adc94d0602 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:58.131705 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d18234fe-79ea-4206-b8f3-66adc94d0602 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:58.314979 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-d18234fe-79ea-4206-b8f3-66adc94d0602 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:58.323271 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-d18234fe-79ea-4206-b8f3-66adc94d0602 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1749 microversion: 2.1 time: 0.204407 Dec 15 13:07:58.324178 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 382/830] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:58 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1749 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:58.458875 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ed4cadd4-3a67-44e4-9e14-e85af0374fb7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:58.459569 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ed4cadd4-3a67-44e4-9e14-e85af0374fb7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:58.465557 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ed4cadd4-3a67-44e4-9e14-e85af0374fb7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:58.466114 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ed4cadd4-3a67-44e4-9e14-e85af0374fb7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:58.466928 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ed4cadd4-3a67-44e4-9e14-e85af0374fb7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:58.467365 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ed4cadd4-3a67-44e4-9e14-e85af0374fb7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:58.700805 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ed4cadd4-3a67-44e4-9e14-e85af0374fb7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:58.709085 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-f29a3f01-30fd-4035-834e-232e2eafa383 tempest-VolumesGetTestJSON-290164546 tempest-VolumesGetTestJSON-290164546-project] Action: 'create', calling method: .version_select at 0x7faf18061160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-771758477", "metadata": {"Type": "work"}}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:07:58.713387 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ed4cadd4-3a67-44e4-9e14-e85af0374fb7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.257489 Dec 15 13:07:58.714633 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 449/831] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:58 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:58.720543 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a454f5be-8447-45c0-a87c-c7d67d378b6b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:58.730884 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a454f5be-8447-45c0-a87c-c7d67d378b6b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:58.738655 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a454f5be-8447-45c0-a87c-c7d67d378b6b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:58.739320 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a454f5be-8447-45c0-a87c-c7d67d378b6b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:58.740153 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a454f5be-8447-45c0-a87c-c7d67d378b6b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:58.740698 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a454f5be-8447-45c0-a87c-c7d67d378b6b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:58.769521 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a454f5be-8447-45c0-a87c-c7d67d378b6b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Going to try to terminate instance {{(pid=116098) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:07:58.864817 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a454f5be-8447-45c0-a87c-c7d67d378b6b tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 204 len: 0 microversion: 2.1 time: 0.148383 Dec 15 13:07:58.868634 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 450/832] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Dec 15 13:07:58 2021] DELETE /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:07:58.876042 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5b1c82eb-6dc2-4121-bf87-ff34ca415605 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:58.877076 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5b1c82eb-6dc2-4121-bf87-ff34ca415605 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:58.883871 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5b1c82eb-6dc2-4121-bf87-ff34ca415605 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:58.884212 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5b1c82eb-6dc2-4121-bf87-ff34ca415605 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:58.885219 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5b1c82eb-6dc2-4121-bf87-ff34ca415605 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:58.887258 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5b1c82eb-6dc2-4121-bf87-ff34ca415605 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:59.030834 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-f29a3f01-30fd-4035-834e-232e2eafa383 tempest-VolumesGetTestJSON-290164546 tempest-VolumesGetTestJSON-290164546-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.465655 Dec 15 13:07:59.031462 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 383/833] 10.222.0.57 () {60 vars in 1155 bytes} [Wed Dec 15 13:07:58 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 467 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 15 13:07:59.043521 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-3e95db92-659e-4f42-86f5-4d275f9e7592 tempest-VolumesGetTestJSON-290164546 tempest-VolumesGetTestJSON-290164546-project] Calling method '.version_select at 0x7faf12f86430>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:59.090737 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5b1c82eb-6dc2-4121-bf87-ff34ca415605 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:59.102048 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5b1c82eb-6dc2-4121-bf87-ff34ca415605 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1513 microversion: 2.1 time: 0.231598 Dec 15 13:07:59.105508 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-3e95db92-659e-4f42-86f5-4d275f9e7592 tempest-VolumesGetTestJSON-290164546 tempest-VolumesGetTestJSON-290164546-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/5cb6cb0c-2cb6-40ba-bf43-e3b6f139305b" status: 200 len: 352 microversion: 2.1 time: 0.066314 Dec 15 13:07:59.106232 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 384/834] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Dec 15 13:07:59 2021] GET /compute/v2.1/os-volumes/5cb6cb0c-2cb6-40ba-bf43-e3b6f139305b => generated 352 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:07:59.109895 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 451/835] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:58 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1513 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:59.340451 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-98733261-bb53-40be-93f1-f6a3f7a1f4e6 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:59.341040 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-98733261-bb53-40be-93f1-f6a3f7a1f4e6 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:59.346908 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-98733261-bb53-40be-93f1-f6a3f7a1f4e6 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:59.347348 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-98733261-bb53-40be-93f1-f6a3f7a1f4e6 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:59.348116 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-98733261-bb53-40be-93f1-f6a3f7a1f4e6 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:59.348546 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-98733261-bb53-40be-93f1-f6a3f7a1f4e6 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:59.490555 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-98733261-bb53-40be-93f1-f6a3f7a1f4e6 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:59.498976 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-98733261-bb53-40be-93f1-f6a3f7a1f4e6 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1754 microversion: 2.1 time: 0.162196 Dec 15 13:07:59.499535 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 452/836] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:59 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:59.731744 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-65b4cf06-9963-4d25-af27-b0151b72be08 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:59.733139 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-65b4cf06-9963-4d25-af27-b0151b72be08 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:59.739585 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-65b4cf06-9963-4d25-af27-b0151b72be08 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:59.740037 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-65b4cf06-9963-4d25-af27-b0151b72be08 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:59.740837 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-65b4cf06-9963-4d25-af27-b0151b72be08 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:59.741268 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-65b4cf06-9963-4d25-af27-b0151b72be08 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:59.873915 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-65b4cf06-9963-4d25-af27-b0151b72be08 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:59.881570 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-65b4cf06-9963-4d25-af27-b0151b72be08 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.154407 Dec 15 13:07:59.882126 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 385/837] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:59 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:00.118677 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-cdaaaeae-0854-4f32-a7f6-677d75f4e206 tempest-VolumesGetTestJSON-290164546 tempest-VolumesGetTestJSON-290164546-project] Calling method '.version_select at 0x7faf180cbe50>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:00.119427 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-85e2f4b2-79e5-4162-bd5a-4deaa9dc6247 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:00.120078 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-85e2f4b2-79e5-4162-bd5a-4deaa9dc6247 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:00.126232 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-85e2f4b2-79e5-4162-bd5a-4deaa9dc6247 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:00.126697 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-85e2f4b2-79e5-4162-bd5a-4deaa9dc6247 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:00.127511 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-85e2f4b2-79e5-4162-bd5a-4deaa9dc6247 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:00.127952 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-85e2f4b2-79e5-4162-bd5a-4deaa9dc6247 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:00.166244 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-cdaaaeae-0854-4f32-a7f6-677d75f4e206 tempest-VolumesGetTestJSON-290164546 tempest-VolumesGetTestJSON-290164546-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/5cb6cb0c-2cb6-40ba-bf43-e3b6f139305b" status: 200 len: 353 microversion: 2.1 time: 0.051735 Dec 15 13:08:00.167424 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 453/838] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Dec 15 13:08:00 2021] GET /compute/v2.1/os-volumes/5cb6cb0c-2cb6-40ba-bf43-e3b6f139305b => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:08:00.177819 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-362dfdfd-175d-4c2a-bb00-91d7158d17c1 tempest-VolumesGetTestJSON-290164546 tempest-VolumesGetTestJSON-290164546-project] Calling method '.version_select at 0x7faf18279ca0>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:00.227136 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-362dfdfd-175d-4c2a-bb00-91d7158d17c1 tempest-VolumesGetTestJSON-290164546 tempest-VolumesGetTestJSON-290164546-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/5cb6cb0c-2cb6-40ba-bf43-e3b6f139305b" status: 200 len: 353 microversion: 2.1 time: 0.052738 Dec 15 13:08:00.227788 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 454/839] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Dec 15 13:08:00 2021] GET /compute/v2.1/os-volumes/5cb6cb0c-2cb6-40ba-bf43-e3b6f139305b => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:08:00.243653 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-246d35a9-33c4-460f-bbc8-9f347c99cefd tempest-VolumesGetTestJSON-290164546 tempest-VolumesGetTestJSON-290164546-project] Calling method '.version_select at 0x7faf180d74c0>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:00.267136 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-85e2f4b2-79e5-4162-bd5a-4deaa9dc6247 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:00.274476 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-85e2f4b2-79e5-4162-bd5a-4deaa9dc6247 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1513 microversion: 2.1 time: 0.158548 Dec 15 13:08:00.275088 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 386/840] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:00 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:08:00.306990 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-246d35a9-33c4-460f-bbc8-9f347c99cefd tempest-VolumesGetTestJSON-290164546 tempest-VolumesGetTestJSON-290164546-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/5cb6cb0c-2cb6-40ba-bf43-e3b6f139305b" status: 202 len: 0 microversion: 2.1 time: 0.066783 Dec 15 13:08:00.307556 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 455/841] 10.222.0.57 () {58 vars in 1247 bytes} [Wed Dec 15 13:08:00 2021] DELETE /compute/v2.1/os-volumes/5cb6cb0c-2cb6-40ba-bf43-e3b6f139305b => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:08:00.315652 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-7da94be4-15d4-410b-81e7-2e28454ec775 tempest-VolumesGetTestJSON-290164546 tempest-VolumesGetTestJSON-290164546-project] Calling method '.version_select at 0x7faf12fc0af0>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:00.363236 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-7da94be4-15d4-410b-81e7-2e28454ec775 tempest-VolumesGetTestJSON-290164546 tempest-VolumesGetTestJSON-290164546-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/5cb6cb0c-2cb6-40ba-bf43-e3b6f139305b" status: 200 len: 352 microversion: 2.1 time: 0.051474 Dec 15 13:08:00.363821 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 387/842] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Dec 15 13:08:00 2021] GET /compute/v2.1/os-volumes/5cb6cb0c-2cb6-40ba-bf43-e3b6f139305b => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:08:00.517034 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6143b3e1-6508-47ea-9558-3a15449ed786 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:00.517638 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-6143b3e1-6508-47ea-9558-3a15449ed786 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:00.523605 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6143b3e1-6508-47ea-9558-3a15449ed786 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:00.524051 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6143b3e1-6508-47ea-9558-3a15449ed786 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:00.524821 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6143b3e1-6508-47ea-9558-3a15449ed786 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:00.525252 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6143b3e1-6508-47ea-9558-3a15449ed786 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:00.675151 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-6143b3e1-6508-47ea-9558-3a15449ed786 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:00.683250 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6143b3e1-6508-47ea-9558-3a15449ed786 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1754 microversion: 2.1 time: 0.170205 Dec 15 13:08:00.683813 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 456/843] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:00 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:00.901352 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-45279f30-dbae-4569-8416-416d2d922893 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:00.901960 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-45279f30-dbae-4569-8416-416d2d922893 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:00.907874 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-45279f30-dbae-4569-8416-416d2d922893 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:00.908321 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-45279f30-dbae-4569-8416-416d2d922893 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:00.909089 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-45279f30-dbae-4569-8416-416d2d922893 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:00.909528 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-45279f30-dbae-4569-8416-416d2d922893 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:01.041156 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-45279f30-dbae-4569-8416-416d2d922893 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:01.048966 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-45279f30-dbae-4569-8416-416d2d922893 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.151757 Dec 15 13:08:01.049544 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 388/844] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:00 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:01.293045 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d8f0c58b-09da-4039-9b19-3c101891f81c tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:01.293648 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d8f0c58b-09da-4039-9b19-3c101891f81c tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:01.299875 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d8f0c58b-09da-4039-9b19-3c101891f81c tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:01.300323 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d8f0c58b-09da-4039-9b19-3c101891f81c tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:01.301089 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d8f0c58b-09da-4039-9b19-3c101891f81c tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:01.301520 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d8f0c58b-09da-4039-9b19-3c101891f81c tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:01.375740 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-2e64daff-8d7c-42ff-9a0a-4590ee7d7cfe tempest-VolumesGetTestJSON-290164546 tempest-VolumesGetTestJSON-290164546-project] Calling method '.version_select at 0x7faf180a7ee0>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:01.402233 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.wsgi [None req-2e64daff-8d7c-42ff-9a0a-4590ee7d7cfe tempest-VolumesGetTestJSON-290164546 tempest-VolumesGetTestJSON-290164546-project] HTTP exception thrown: Volume 5cb6cb0c-2cb6-40ba-bf43-e3b6f139305b could not be found. Dec 15 13:08:01.402857 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-2e64daff-8d7c-42ff-9a0a-4590ee7d7cfe tempest-VolumesGetTestJSON-290164546 tempest-VolumesGetTestJSON-290164546-project] Returning 404 to user: Volume 5cb6cb0c-2cb6-40ba-bf43-e3b6f139305b could not be found. {{(pid=116097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:08:01.403681 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-2e64daff-8d7c-42ff-9a0a-4590ee7d7cfe tempest-VolumesGetTestJSON-290164546 tempest-VolumesGetTestJSON-290164546-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/5cb6cb0c-2cb6-40ba-bf43-e3b6f139305b" status: 404 len: 109 microversion: 2.1 time: 0.031569 Dec 15 13:08:01.404217 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 389/845] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Dec 15 13:08:01 2021] GET /compute/v2.1/os-volumes/5cb6cb0c-2cb6-40ba-bf43-e3b6f139305b => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 13:08:01.438107 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d8f0c58b-09da-4039-9b19-3c101891f81c tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:01.448681 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d8f0c58b-09da-4039-9b19-3c101891f81c tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1513 microversion: 2.1 time: 0.159672 Dec 15 13:08:01.449716 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 457/846] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:01 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:01.701914 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-0caa3d7d-9cbc-4759-87c2-f7a9dd0a677b tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:01.703238 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-0caa3d7d-9cbc-4759-87c2-f7a9dd0a677b tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:01.711979 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0caa3d7d-9cbc-4759-87c2-f7a9dd0a677b tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:01.712737 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0caa3d7d-9cbc-4759-87c2-f7a9dd0a677b tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:01.714248 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0caa3d7d-9cbc-4759-87c2-f7a9dd0a677b tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:01.714882 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0caa3d7d-9cbc-4759-87c2-f7a9dd0a677b tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:01.928544 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-0caa3d7d-9cbc-4759-87c2-f7a9dd0a677b tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:01.937488 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-0caa3d7d-9cbc-4759-87c2-f7a9dd0a677b tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1754 microversion: 2.1 time: 0.240061 Dec 15 13:08:01.938131 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 390/847] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:01 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1754 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:02.067964 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-22279665-1596-45d2-9e69-46b8cf7ec332 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:02.069244 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-22279665-1596-45d2-9e69-46b8cf7ec332 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:02.076460 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-22279665-1596-45d2-9e69-46b8cf7ec332 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:02.076944 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-22279665-1596-45d2-9e69-46b8cf7ec332 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:02.077792 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-22279665-1596-45d2-9e69-46b8cf7ec332 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:02.078321 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-22279665-1596-45d2-9e69-46b8cf7ec332 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:02.199982 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-4c142bcb-3f9a-45a7-a2f6-2f22cd6cab5c req-47071055-76de-4d20-863b-aec3b3f84f38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8be01f4-a176-41ba-b710-1a2fe19b85f5", "name": "network-vif-deleted", "tag": "10b5cfb7-0ae1-469d-b8d2-adb0846fc020"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:08:02.204992 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:08:02.204992 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:08:02.218219 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-4c142bcb-3f9a-45a7-a2f6-2f22cd6cab5c req-47071055-76de-4d20-863b-aec3b3f84f38 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:02.218801 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-4c142bcb-3f9a-45a7-a2f6-2f22cd6cab5c req-47071055-76de-4d20-863b-aec3b3f84f38 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:02.243673 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-4c142bcb-3f9a-45a7-a2f6-2f22cd6cab5c req-47071055-76de-4d20-863b-aec3b3f84f38 service nova] Creating event network-vif-deleted:10b5cfb7-0ae1-469d-b8d2-adb0846fc020 for instance d8be01f4-a176-41ba-b710-1a2fe19b85f5 on hv-cinder-81322 Dec 15 13:08:02.249556 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-4c142bcb-3f9a-45a7-a2f6-2f22cd6cab5c req-47071055-76de-4d20-863b-aec3b3f84f38 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063399 Dec 15 13:08:02.250804 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 391/848] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:08:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:08:02.288055 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-22279665-1596-45d2-9e69-46b8cf7ec332 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:02.298023 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-22279665-1596-45d2-9e69-46b8cf7ec332 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.234984 Dec 15 13:08:02.299363 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 458/849] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:02 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:02.473654 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-2cd16add-558d-4602-a5dd-ec2363378cd1 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:02.474856 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-2cd16add-558d-4602-a5dd-ec2363378cd1 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:02.481809 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2cd16add-558d-4602-a5dd-ec2363378cd1 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:02.482295 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2cd16add-558d-4602-a5dd-ec2363378cd1 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:02.483091 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2cd16add-558d-4602-a5dd-ec2363378cd1 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:02.483526 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2cd16add-558d-4602-a5dd-ec2363378cd1 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:02.516900 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2cd16add-558d-4602-a5dd-ec2363378cd1 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:02.517366 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2cd16add-558d-4602-a5dd-ec2363378cd1 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:02.517823 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.objects.instance [None req-2cd16add-558d-4602-a5dd-ec2363378cd1 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lazy-loading 'fault' on Instance uuid d8be01f4-a176-41ba-b710-1a2fe19b85f5 {{(pid=116097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:08:02.561363 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-2cd16add-558d-4602-a5dd-ec2363378cd1 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047982e41574460caa4bf3b79a9a8370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fe36399a34538b3b4da9464f43df3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:02.569781 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-2cd16add-558d-4602-a5dd-ec2363378cd1 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 200 len: 1309 microversion: 2.1 time: 0.107216 Dec 15 13:08:02.570366 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 392/850] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:02 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 1309 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:02.954894 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-02ac4e27-68d3-4d7a-8e3e-369cf9be545a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:02.955490 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-02ac4e27-68d3-4d7a-8e3e-369cf9be545a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:02.962428 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-02ac4e27-68d3-4d7a-8e3e-369cf9be545a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:02.962902 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-02ac4e27-68d3-4d7a-8e3e-369cf9be545a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:02.963671 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-02ac4e27-68d3-4d7a-8e3e-369cf9be545a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:02.964097 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-02ac4e27-68d3-4d7a-8e3e-369cf9be545a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:03.110879 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-02ac4e27-68d3-4d7a-8e3e-369cf9be545a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:03.119428 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-02ac4e27-68d3-4d7a-8e3e-369cf9be545a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1754 microversion: 2.1 time: 0.167935 Dec 15 13:08:03.120217 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 459/851] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:02 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:03.316536 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-b2ef47c3-f927-4b8d-920e-44c1a6b6cc5d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:03.317145 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-b2ef47c3-f927-4b8d-920e-44c1a6b6cc5d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:03.323387 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b2ef47c3-f927-4b8d-920e-44c1a6b6cc5d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:03.323839 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b2ef47c3-f927-4b8d-920e-44c1a6b6cc5d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:03.324619 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b2ef47c3-f927-4b8d-920e-44c1a6b6cc5d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:03.325058 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b2ef47c3-f927-4b8d-920e-44c1a6b6cc5d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:03.462333 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-b2ef47c3-f927-4b8d-920e-44c1a6b6cc5d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:03.470559 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-b2ef47c3-f927-4b8d-920e-44c1a6b6cc5d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.157613 Dec 15 13:08:03.471113 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 393/852] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:03 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:03.586992 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7652b07b-5291-4262-9918-fd72cbc8c793 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:03.587715 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7652b07b-5291-4262-9918-fd72cbc8c793 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] [instance: d8be01f4-a176-41ba-b710-1a2fe19b85f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:03.594486 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7652b07b-5291-4262-9918-fd72cbc8c793 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:03.594915 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7652b07b-5291-4262-9918-fd72cbc8c793 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:03.595683 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7652b07b-5291-4262-9918-fd72cbc8c793 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:03.596103 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7652b07b-5291-4262-9918-fd72cbc8c793 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:03.609677 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-7652b07b-5291-4262-9918-fd72cbc8c793 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] HTTP exception thrown: Instance d8be01f4-a176-41ba-b710-1a2fe19b85f5 could not be found. Dec 15 13:08:03.610015 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7652b07b-5291-4262-9918-fd72cbc8c793 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] Returning 404 to user: Instance d8be01f4-a176-41ba-b710-1a2fe19b85f5 could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:08:03.611158 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7652b07b-5291-4262-9918-fd72cbc8c793 tempest-VolumesSnapshotTestJSON-181492370 tempest-VolumesSnapshotTestJSON-181492370-project] 10.222.0.57 "GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5" status: 404 len: 111 microversion: 2.1 time: 0.027914 Dec 15 13:08:03.611680 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 460/853] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:03 2021] GET /compute/v2.1/servers/d8be01f4-a176-41ba-b710-1a2fe19b85f5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:08:04.137730 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-7b3a7a74-b560-4bdc-a667-964dc5245330 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:04.138301 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-7b3a7a74-b560-4bdc-a667-964dc5245330 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:04.144695 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7b3a7a74-b560-4bdc-a667-964dc5245330 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:04.145135 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7b3a7a74-b560-4bdc-a667-964dc5245330 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:04.145918 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7b3a7a74-b560-4bdc-a667-964dc5245330 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:04.146376 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7b3a7a74-b560-4bdc-a667-964dc5245330 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:04.290751 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-7b3a7a74-b560-4bdc-a667-964dc5245330 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:04.299082 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-7b3a7a74-b560-4bdc-a667-964dc5245330 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1754 microversion: 2.1 time: 0.165627 Dec 15 13:08:04.299629 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 394/854] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:04 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:04.488208 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-45d5ef6d-ba8b-4c80-a9fb-644d6f6959a4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:04.488772 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-45d5ef6d-ba8b-4c80-a9fb-644d6f6959a4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:04.496433 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-45d5ef6d-ba8b-4c80-a9fb-644d6f6959a4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:04.496883 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-45d5ef6d-ba8b-4c80-a9fb-644d6f6959a4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:04.497675 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-45d5ef6d-ba8b-4c80-a9fb-644d6f6959a4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:04.498184 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-45d5ef6d-ba8b-4c80-a9fb-644d6f6959a4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:04.631065 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-45d5ef6d-ba8b-4c80-a9fb-644d6f6959a4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:04.639179 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-45d5ef6d-ba8b-4c80-a9fb-644d6f6959a4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.154715 Dec 15 13:08:04.639736 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 461/855] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:04 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:08:05.316978 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-1490e381-a71a-4a15-adb8-289078660ca3 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:05.317507 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-1490e381-a71a-4a15-adb8-289078660ca3 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:05.324231 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1490e381-a71a-4a15-adb8-289078660ca3 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:05.324672 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1490e381-a71a-4a15-adb8-289078660ca3 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:05.325444 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1490e381-a71a-4a15-adb8-289078660ca3 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:05.325876 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1490e381-a71a-4a15-adb8-289078660ca3 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:05.475955 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-1490e381-a71a-4a15-adb8-289078660ca3 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:05.483720 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-1490e381-a71a-4a15-adb8-289078660ca3 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1754 microversion: 2.1 time: 0.170740 Dec 15 13:08:05.484279 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 395/856] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:05 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:05.656003 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6dab17ec-84f6-425c-91de-0bedcdbdab56 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:05.656607 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-6dab17ec-84f6-425c-91de-0bedcdbdab56 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:05.662830 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6dab17ec-84f6-425c-91de-0bedcdbdab56 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:05.663274 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6dab17ec-84f6-425c-91de-0bedcdbdab56 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:05.664043 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6dab17ec-84f6-425c-91de-0bedcdbdab56 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:05.664472 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6dab17ec-84f6-425c-91de-0bedcdbdab56 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:05.796706 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-6dab17ec-84f6-425c-91de-0bedcdbdab56 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:05.804575 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6dab17ec-84f6-425c-91de-0bedcdbdab56 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.152201 Dec 15 13:08:05.805140 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 462/857] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:05 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:06.500935 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-6d2a966e-da2c-4ffa-8ce0-72bdcd57d5ce tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:06.501541 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-6d2a966e-da2c-4ffa-8ce0-72bdcd57d5ce tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:06.508491 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6d2a966e-da2c-4ffa-8ce0-72bdcd57d5ce tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:06.509051 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6d2a966e-da2c-4ffa-8ce0-72bdcd57d5ce tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:06.509820 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6d2a966e-da2c-4ffa-8ce0-72bdcd57d5ce tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:06.510771 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6d2a966e-da2c-4ffa-8ce0-72bdcd57d5ce tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:06.652769 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-6d2a966e-da2c-4ffa-8ce0-72bdcd57d5ce tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:06.660386 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-6d2a966e-da2c-4ffa-8ce0-72bdcd57d5ce tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1754 microversion: 2.1 time: 0.163394 Dec 15 13:08:06.660941 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 396/858] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:06 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:06.821834 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-934aad2e-c03b-4cde-a9fa-2a5f0dc53b20 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:06.822454 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-934aad2e-c03b-4cde-a9fa-2a5f0dc53b20 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:06.829174 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-934aad2e-c03b-4cde-a9fa-2a5f0dc53b20 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:06.829615 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-934aad2e-c03b-4cde-a9fa-2a5f0dc53b20 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:06.830413 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-934aad2e-c03b-4cde-a9fa-2a5f0dc53b20 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:06.830841 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-934aad2e-c03b-4cde-a9fa-2a5f0dc53b20 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:06.956477 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-934aad2e-c03b-4cde-a9fa-2a5f0dc53b20 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:06.965882 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-934aad2e-c03b-4cde-a9fa-2a5f0dc53b20 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.147642 Dec 15 13:08:06.966559 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 463/859] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:06 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:07.677336 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-86bc0308-cb7d-4216-840f-af24adcc4b38 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:07.677933 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-86bc0308-cb7d-4216-840f-af24adcc4b38 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:07.684351 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-86bc0308-cb7d-4216-840f-af24adcc4b38 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:07.684795 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-86bc0308-cb7d-4216-840f-af24adcc4b38 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:07.685556 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-86bc0308-cb7d-4216-840f-af24adcc4b38 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:07.685987 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-86bc0308-cb7d-4216-840f-af24adcc4b38 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:07.836090 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-86bc0308-cb7d-4216-840f-af24adcc4b38 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:07.844339 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-86bc0308-cb7d-4216-840f-af24adcc4b38 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1754 microversion: 2.1 time: 0.171008 Dec 15 13:08:07.844923 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 397/860] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:07 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1754 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:07.985180 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-68fb5d1c-9934-44c9-8c78-a97a2ebdffa3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:07.985703 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-68fb5d1c-9934-44c9-8c78-a97a2ebdffa3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:07.991870 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-68fb5d1c-9934-44c9-8c78-a97a2ebdffa3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:07.992312 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-68fb5d1c-9934-44c9-8c78-a97a2ebdffa3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:07.993074 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-68fb5d1c-9934-44c9-8c78-a97a2ebdffa3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:07.993501 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-68fb5d1c-9934-44c9-8c78-a97a2ebdffa3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:08.125738 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-68fb5d1c-9934-44c9-8c78-a97a2ebdffa3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:08.133408 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-68fb5d1c-9934-44c9-8c78-a97a2ebdffa3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.152391 Dec 15 13:08:08.133957 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 464/861] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:07 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:08.861116 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-90e0e2a0-a262-416f-92f2-619f48920361 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:08.861754 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-90e0e2a0-a262-416f-92f2-619f48920361 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:08.868164 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-90e0e2a0-a262-416f-92f2-619f48920361 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:08.868610 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-90e0e2a0-a262-416f-92f2-619f48920361 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:08.869376 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-90e0e2a0-a262-416f-92f2-619f48920361 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:08.869830 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-90e0e2a0-a262-416f-92f2-619f48920361 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:09.010374 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-90e0e2a0-a262-416f-92f2-619f48920361 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:09.018513 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-90e0e2a0-a262-416f-92f2-619f48920361 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1754 microversion: 2.1 time: 0.161008 Dec 15 13:08:09.019075 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 398/862] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:08 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:09.150469 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-74142adb-d3a1-4643-a1ac-ccd07550af3d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:09.151077 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-74142adb-d3a1-4643-a1ac-ccd07550af3d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:09.157378 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-74142adb-d3a1-4643-a1ac-ccd07550af3d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:09.157823 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-74142adb-d3a1-4643-a1ac-ccd07550af3d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:09.158620 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-74142adb-d3a1-4643-a1ac-ccd07550af3d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:09.159053 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-74142adb-d3a1-4643-a1ac-ccd07550af3d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:09.286199 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-74142adb-d3a1-4643-a1ac-ccd07550af3d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:09.294759 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-74142adb-d3a1-4643-a1ac-ccd07550af3d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.147823 Dec 15 13:08:09.304235 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 465/863] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:09 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:10.035359 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-a56e73b8-7232-4705-b82d-6f2be3d183ee tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:10.035971 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-a56e73b8-7232-4705-b82d-6f2be3d183ee tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:10.044194 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a56e73b8-7232-4705-b82d-6f2be3d183ee tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:10.044647 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a56e73b8-7232-4705-b82d-6f2be3d183ee tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:10.045433 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a56e73b8-7232-4705-b82d-6f2be3d183ee tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:10.045873 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a56e73b8-7232-4705-b82d-6f2be3d183ee tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:10.186002 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-a56e73b8-7232-4705-b82d-6f2be3d183ee tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:10.200385 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-a56e73b8-7232-4705-b82d-6f2be3d183ee tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1754 microversion: 2.1 time: 0.168560 Dec 15 13:08:10.200958 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 399/864] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:10 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:08:10.311638 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f2ab4218-22c8-4070-b85f-4c653c8a8da4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:10.312155 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f2ab4218-22c8-4070-b85f-4c653c8a8da4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:10.318341 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f2ab4218-22c8-4070-b85f-4c653c8a8da4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:10.318781 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f2ab4218-22c8-4070-b85f-4c653c8a8da4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:10.319545 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f2ab4218-22c8-4070-b85f-4c653c8a8da4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:10.319982 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f2ab4218-22c8-4070-b85f-4c653c8a8da4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:10.450833 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f2ab4218-22c8-4070-b85f-4c653c8a8da4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:10.458717 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f2ab4218-22c8-4070-b85f-4c653c8a8da4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.150914 Dec 15 13:08:10.459287 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 466/865] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:10 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:11.218776 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-271ce4b2-b233-4a63-85a0-d950a0b6fee8 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:11.219457 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-271ce4b2-b233-4a63-85a0-d950a0b6fee8 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:11.225698 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-271ce4b2-b233-4a63-85a0-d950a0b6fee8 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:11.226160 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-271ce4b2-b233-4a63-85a0-d950a0b6fee8 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:11.226969 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-271ce4b2-b233-4a63-85a0-d950a0b6fee8 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:11.227406 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-271ce4b2-b233-4a63-85a0-d950a0b6fee8 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:11.375474 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-271ce4b2-b233-4a63-85a0-d950a0b6fee8 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:11.383115 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-271ce4b2-b233-4a63-85a0-d950a0b6fee8 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1754 microversion: 2.1 time: 0.168311 Dec 15 13:08:11.383677 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 400/866] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:11 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:11.476117 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-de8240d5-3f8c-4d3e-b382-a3fc5bde6419 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:11.476662 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-de8240d5-3f8c-4d3e-b382-a3fc5bde6419 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:11.483525 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-de8240d5-3f8c-4d3e-b382-a3fc5bde6419 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:11.483969 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-de8240d5-3f8c-4d3e-b382-a3fc5bde6419 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:11.484733 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-de8240d5-3f8c-4d3e-b382-a3fc5bde6419 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:11.485167 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-de8240d5-3f8c-4d3e-b382-a3fc5bde6419 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:11.613595 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-de8240d5-3f8c-4d3e-b382-a3fc5bde6419 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:11.621183 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-de8240d5-3f8c-4d3e-b382-a3fc5bde6419 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.148801 Dec 15 13:08:11.621745 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 467/867] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:11 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:12.400341 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-ae33ed2c-a369-411a-b72f-cb76e9b09b0b tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:12.400979 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-ae33ed2c-a369-411a-b72f-cb76e9b09b0b tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:12.407192 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ae33ed2c-a369-411a-b72f-cb76e9b09b0b tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:12.407639 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ae33ed2c-a369-411a-b72f-cb76e9b09b0b tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:12.408408 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ae33ed2c-a369-411a-b72f-cb76e9b09b0b tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:12.408841 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ae33ed2c-a369-411a-b72f-cb76e9b09b0b tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:12.546530 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-ae33ed2c-a369-411a-b72f-cb76e9b09b0b tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:12.554215 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-ae33ed2c-a369-411a-b72f-cb76e9b09b0b tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1754 microversion: 2.1 time: 0.157577 Dec 15 13:08:12.554775 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 401/868] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:12 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:12.637716 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-85533427-fdcd-45f0-9cf1-9fcb45df39b7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:12.638643 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-85533427-fdcd-45f0-9cf1-9fcb45df39b7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:12.645643 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-85533427-fdcd-45f0-9cf1-9fcb45df39b7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:12.646303 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-85533427-fdcd-45f0-9cf1-9fcb45df39b7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:12.647275 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-85533427-fdcd-45f0-9cf1-9fcb45df39b7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:12.647701 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-85533427-fdcd-45f0-9cf1-9fcb45df39b7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:12.774193 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-85533427-fdcd-45f0-9cf1-9fcb45df39b7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:12.782644 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-85533427-fdcd-45f0-9cf1-9fcb45df39b7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.148523 Dec 15 13:08:12.783213 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 468/869] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:12 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:13.572961 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-d3bffff3-8c9b-4d1b-833a-472543e3710c tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:13.573578 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-d3bffff3-8c9b-4d1b-833a-472543e3710c tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:13.579899 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d3bffff3-8c9b-4d1b-833a-472543e3710c tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:13.580354 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d3bffff3-8c9b-4d1b-833a-472543e3710c tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:13.581135 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d3bffff3-8c9b-4d1b-833a-472543e3710c tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:13.581579 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d3bffff3-8c9b-4d1b-833a-472543e3710c tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:13.723861 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-d3bffff3-8c9b-4d1b-833a-472543e3710c tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:13.731556 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-d3bffff3-8c9b-4d1b-833a-472543e3710c tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1754 microversion: 2.1 time: 0.162804 Dec 15 13:08:13.732510 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 402/870] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:13 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:13.800191 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-cf5d29b8-4e22-49c6-97b7-d1c16f776a1b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:13.800817 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-cf5d29b8-4e22-49c6-97b7-d1c16f776a1b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:13.807840 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cf5d29b8-4e22-49c6-97b7-d1c16f776a1b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:13.808550 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cf5d29b8-4e22-49c6-97b7-d1c16f776a1b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:13.810074 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cf5d29b8-4e22-49c6-97b7-d1c16f776a1b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:13.810610 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cf5d29b8-4e22-49c6-97b7-d1c16f776a1b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:13.952126 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-cf5d29b8-4e22-49c6-97b7-d1c16f776a1b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:13.961097 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-cf5d29b8-4e22-49c6-97b7-d1c16f776a1b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.164445 Dec 15 13:08:13.962212 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 469/871] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:13 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:14.375847 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-1f423890-a46f-4543-a72d-f7415feb7aff tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:14.376349 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-1f423890-a46f-4543-a72d-f7415feb7aff tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:14.382397 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1f423890-a46f-4543-a72d-f7415feb7aff tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:14.383090 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1f423890-a46f-4543-a72d-f7415feb7aff tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:14.384559 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1f423890-a46f-4543-a72d-f7415feb7aff tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:14.385731 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1f423890-a46f-4543-a72d-f7415feb7aff tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:14.464894 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.objects.instance [None req-1f423890-a46f-4543-a72d-f7415feb7aff tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lazy-loading 'services' on Instance uuid 8d29665f-f416-4d8b-8a0a-7e1eb1515440 {{(pid=116097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:08:14.530997 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-1f423890-a46f-4543-a72d-f7415feb7aff tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/os-volume_attachments/1875cf69-238a-4ec8-ae41-77a9137010c8" status: 202 len: 0 microversion: 2.1 time: 0.158962 Dec 15 13:08:14.531574 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 403/872] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Dec 15 13:08:14 2021] DELETE /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/os-volume_attachments/1875cf69-238a-4ec8-ae41-77a9137010c8 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:08:14.749127 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-93b81b2c-5458-45df-8ed0-b758f89497f8 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:14.749725 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-93b81b2c-5458-45df-8ed0-b758f89497f8 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:14.755398 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-93b81b2c-5458-45df-8ed0-b758f89497f8 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:14.755835 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-93b81b2c-5458-45df-8ed0-b758f89497f8 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:14.756590 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-93b81b2c-5458-45df-8ed0-b758f89497f8 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:14.757018 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-93b81b2c-5458-45df-8ed0-b758f89497f8 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:14.898304 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-93b81b2c-5458-45df-8ed0-b758f89497f8 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:14.906040 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-93b81b2c-5458-45df-8ed0-b758f89497f8 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1754 microversion: 2.1 time: 0.160531 Dec 15 13:08:14.907746 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 470/873] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:14 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:14.981064 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-4474f583-7de5-4b1d-ac20-aca7a2be13fd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:14.981813 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-4474f583-7de5-4b1d-ac20-aca7a2be13fd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:14.987944 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4474f583-7de5-4b1d-ac20-aca7a2be13fd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:14.988390 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4474f583-7de5-4b1d-ac20-aca7a2be13fd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:14.989190 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4474f583-7de5-4b1d-ac20-aca7a2be13fd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:14.989648 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4474f583-7de5-4b1d-ac20-aca7a2be13fd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:15.121818 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-4474f583-7de5-4b1d-ac20-aca7a2be13fd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:15.129421 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-4474f583-7de5-4b1d-ac20-aca7a2be13fd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.153279 Dec 15 13:08:15.129984 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 404/874] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:14 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:15.636830 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-93a010a2-66ce-48e7-9db0-99261eb481d4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:08:15.643358 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-93a010a2-66ce-48e7-9db0-99261eb481d4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:15.643809 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-93a010a2-66ce-48e7-9db0-99261eb481d4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:15.666812 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-93a010a2-66ce-48e7-9db0-99261eb481d4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Going to try to stop instance {{(pid=116098) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 15 13:08:15.712460 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-93a010a2-66ce-48e7-9db0-99261eb481d4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 202 len: 0 microversion: 2.1 time: 0.079204 Dec 15 13:08:15.713250 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 471/875] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:08:15 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:08:15.722493 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-fd9646de-9c87-43f2-9920-ddbc589b8be3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:15.723189 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-fd9646de-9c87-43f2-9920-ddbc589b8be3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:15.729968 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fd9646de-9c87-43f2-9920-ddbc589b8be3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:15.730450 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fd9646de-9c87-43f2-9920-ddbc589b8be3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:15.731302 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fd9646de-9c87-43f2-9920-ddbc589b8be3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:15.731965 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fd9646de-9c87-43f2-9920-ddbc589b8be3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:15.862470 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-fd9646de-9c87-43f2-9920-ddbc589b8be3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:15.869685 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-fd9646de-9c87-43f2-9920-ddbc589b8be3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1677 microversion: 2.1 time: 0.152078 Dec 15 13:08:15.870259 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 405/876] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:15 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:08:15.923538 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5d579d07-74fc-4d91-9593-8780582a7ef7 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:15.924182 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5d579d07-74fc-4d91-9593-8780582a7ef7 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:15.930090 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5d579d07-74fc-4d91-9593-8780582a7ef7 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:15.930574 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5d579d07-74fc-4d91-9593-8780582a7ef7 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:15.931346 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5d579d07-74fc-4d91-9593-8780582a7ef7 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:15.931784 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5d579d07-74fc-4d91-9593-8780582a7ef7 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:16.082323 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5d579d07-74fc-4d91-9593-8780582a7ef7 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:16.090524 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5d579d07-74fc-4d91-9593-8780582a7ef7 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1754 microversion: 2.1 time: 0.171321 Dec 15 13:08:16.091282 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 472/877] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:15 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1754 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:16.146602 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-b2dc4069-bd3b-457b-9e46-8b572bdfdc4e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:16.147206 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-b2dc4069-bd3b-457b-9e46-8b572bdfdc4e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:16.154073 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b2dc4069-bd3b-457b-9e46-8b572bdfdc4e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:16.154686 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b2dc4069-bd3b-457b-9e46-8b572bdfdc4e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:16.156211 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b2dc4069-bd3b-457b-9e46-8b572bdfdc4e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:16.156659 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b2dc4069-bd3b-457b-9e46-8b572bdfdc4e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:16.298377 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-b2dc4069-bd3b-457b-9e46-8b572bdfdc4e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:16.306133 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-b2dc4069-bd3b-457b-9e46-8b572bdfdc4e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.163118 Dec 15 13:08:16.306713 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 406/878] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:16 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:08:16.886930 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1b602b05-39b8-4c8b-a396-5bf5b73452ee tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:16.887585 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1b602b05-39b8-4c8b-a396-5bf5b73452ee tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:16.893906 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1b602b05-39b8-4c8b-a396-5bf5b73452ee tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:16.894362 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1b602b05-39b8-4c8b-a396-5bf5b73452ee tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:16.895126 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1b602b05-39b8-4c8b-a396-5bf5b73452ee tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:16.895556 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1b602b05-39b8-4c8b-a396-5bf5b73452ee tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:17.026713 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1b602b05-39b8-4c8b-a396-5bf5b73452ee tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:17.033916 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1b602b05-39b8-4c8b-a396-5bf5b73452ee tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1677 microversion: 2.1 time: 0.151245 Dec 15 13:08:17.034495 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 473/879] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:16 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:17.107662 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-9e3b0ac4-c120-473a-95b7-e6901a4ce020 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:17.108275 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-9e3b0ac4-c120-473a-95b7-e6901a4ce020 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:17.114052 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9e3b0ac4-c120-473a-95b7-e6901a4ce020 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:17.114524 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9e3b0ac4-c120-473a-95b7-e6901a4ce020 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:17.115285 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9e3b0ac4-c120-473a-95b7-e6901a4ce020 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:17.115715 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9e3b0ac4-c120-473a-95b7-e6901a4ce020 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:17.259614 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-9e3b0ac4-c120-473a-95b7-e6901a4ce020 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:17.268287 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-9e3b0ac4-c120-473a-95b7-e6901a4ce020 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1754 microversion: 2.1 time: 0.165089 Dec 15 13:08:17.268993 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 407/880] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:17 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:17.321950 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0993999c-12e9-40c0-8f57-26ad3152ad23 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:17.322627 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0993999c-12e9-40c0-8f57-26ad3152ad23 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:17.328323 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0993999c-12e9-40c0-8f57-26ad3152ad23 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:17.328765 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0993999c-12e9-40c0-8f57-26ad3152ad23 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:17.329528 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0993999c-12e9-40c0-8f57-26ad3152ad23 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:17.329968 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0993999c-12e9-40c0-8f57-26ad3152ad23 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:17.461091 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0993999c-12e9-40c0-8f57-26ad3152ad23 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:17.469432 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-0993999c-12e9-40c0-8f57-26ad3152ad23 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.151148 Dec 15 13:08:17.469984 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 474/881] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:17 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:18.051809 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-211fe914-6b8c-4e32-8518-7a32a5ea96a9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:18.052432 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-211fe914-6b8c-4e32-8518-7a32a5ea96a9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:18.058852 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-211fe914-6b8c-4e32-8518-7a32a5ea96a9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:18.059307 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-211fe914-6b8c-4e32-8518-7a32a5ea96a9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:18.060086 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-211fe914-6b8c-4e32-8518-7a32a5ea96a9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:18.060523 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-211fe914-6b8c-4e32-8518-7a32a5ea96a9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:18.201114 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-211fe914-6b8c-4e32-8518-7a32a5ea96a9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:18.208429 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-211fe914-6b8c-4e32-8518-7a32a5ea96a9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1677 microversion: 2.1 time: 0.160204 Dec 15 13:08:18.208994 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 408/882] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:18 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:18.290080 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-2f4979c3-ad24-4635-9105-6a08c1e48103 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:18.291015 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-2f4979c3-ad24-4635-9105-6a08c1e48103 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:18.297225 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2f4979c3-ad24-4635-9105-6a08c1e48103 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:18.297675 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2f4979c3-ad24-4635-9105-6a08c1e48103 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:18.298483 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2f4979c3-ad24-4635-9105-6a08c1e48103 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:18.298919 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2f4979c3-ad24-4635-9105-6a08c1e48103 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:18.439807 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-2f4979c3-ad24-4635-9105-6a08c1e48103 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:18.447522 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-2f4979c3-ad24-4635-9105-6a08c1e48103 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1754 microversion: 2.1 time: 0.163452 Dec 15 13:08:18.448084 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 475/883] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:18 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:18.485675 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-bafc8468-b8c7-41da-aa6e-0150f32fe457 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:18.486313 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-bafc8468-b8c7-41da-aa6e-0150f32fe457 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:18.492117 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-bafc8468-b8c7-41da-aa6e-0150f32fe457 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:18.492566 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-bafc8468-b8c7-41da-aa6e-0150f32fe457 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:18.493332 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-bafc8468-b8c7-41da-aa6e-0150f32fe457 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:18.494456 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-bafc8468-b8c7-41da-aa6e-0150f32fe457 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:18.626698 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-bafc8468-b8c7-41da-aa6e-0150f32fe457 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:18.633859 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-bafc8468-b8c7-41da-aa6e-0150f32fe457 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.151744 Dec 15 13:08:18.634449 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 409/884] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:18 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:19.225359 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6772b14a-cf7d-49cf-933a-8d1e7ff93e2c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:19.225990 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-6772b14a-cf7d-49cf-933a-8d1e7ff93e2c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:19.231796 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6772b14a-cf7d-49cf-933a-8d1e7ff93e2c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:19.232240 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6772b14a-cf7d-49cf-933a-8d1e7ff93e2c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:19.233007 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6772b14a-cf7d-49cf-933a-8d1e7ff93e2c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:19.233445 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6772b14a-cf7d-49cf-933a-8d1e7ff93e2c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:19.360854 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-6772b14a-cf7d-49cf-933a-8d1e7ff93e2c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:19.368212 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6772b14a-cf7d-49cf-933a-8d1e7ff93e2c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1677 microversion: 2.1 time: 0.146580 Dec 15 13:08:19.368783 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 476/885] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:19 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:19.464680 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-a41d823e-6f8d-490d-9db0-058ac9fb29ba tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:19.465353 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-a41d823e-6f8d-490d-9db0-058ac9fb29ba tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:19.471508 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a41d823e-6f8d-490d-9db0-058ac9fb29ba tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:19.471955 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a41d823e-6f8d-490d-9db0-058ac9fb29ba tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:19.472720 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a41d823e-6f8d-490d-9db0-058ac9fb29ba tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:19.473157 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a41d823e-6f8d-490d-9db0-058ac9fb29ba tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:19.614179 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-a41d823e-6f8d-490d-9db0-058ac9fb29ba tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:19.622805 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-a41d823e-6f8d-490d-9db0-058ac9fb29ba tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1754 microversion: 2.1 time: 0.162267 Dec 15 13:08:19.623379 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 410/886] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:19 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:19.650401 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b0b0fa7c-b0c0-4ae0-bfbe-3cd497bbdfc7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:19.651081 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b0b0fa7c-b0c0-4ae0-bfbe-3cd497bbdfc7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:19.656774 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b0b0fa7c-b0c0-4ae0-bfbe-3cd497bbdfc7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:19.657212 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b0b0fa7c-b0c0-4ae0-bfbe-3cd497bbdfc7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:19.657969 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b0b0fa7c-b0c0-4ae0-bfbe-3cd497bbdfc7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:19.658427 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b0b0fa7c-b0c0-4ae0-bfbe-3cd497bbdfc7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:19.786606 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b0b0fa7c-b0c0-4ae0-bfbe-3cd497bbdfc7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:19.794124 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b0b0fa7c-b0c0-4ae0-bfbe-3cd497bbdfc7 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.147362 Dec 15 13:08:19.794700 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 477/887] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:19 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:20.384291 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-01b23e26-37cd-4e18-b017-a2b60a5daa4f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:20.384899 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-01b23e26-37cd-4e18-b017-a2b60a5daa4f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:20.390836 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-01b23e26-37cd-4e18-b017-a2b60a5daa4f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:20.391284 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-01b23e26-37cd-4e18-b017-a2b60a5daa4f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:20.392051 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-01b23e26-37cd-4e18-b017-a2b60a5daa4f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:20.392491 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-01b23e26-37cd-4e18-b017-a2b60a5daa4f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:20.518082 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-01b23e26-37cd-4e18-b017-a2b60a5daa4f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:20.525930 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-01b23e26-37cd-4e18-b017-a2b60a5daa4f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1677 microversion: 2.1 time: 0.145101 Dec 15 13:08:20.526768 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 411/888] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:20 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:20.640127 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-743180d0-b7f4-4090-b971-22c07f521c41 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:20.640730 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-743180d0-b7f4-4090-b971-22c07f521c41 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:20.646971 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-743180d0-b7f4-4090-b971-22c07f521c41 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:20.647420 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-743180d0-b7f4-4090-b971-22c07f521c41 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:20.648201 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-743180d0-b7f4-4090-b971-22c07f521c41 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:20.648635 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-743180d0-b7f4-4090-b971-22c07f521c41 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:20.787800 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-743180d0-b7f4-4090-b971-22c07f521c41 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:20.796007 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-743180d0-b7f4-4090-b971-22c07f521c41 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1754 microversion: 2.1 time: 0.159985 Dec 15 13:08:20.796571 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 478/889] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:20 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:20.811179 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-f93759c8-4037-4e62-aa73-d844919b0e6c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:20.811779 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-f93759c8-4037-4e62-aa73-d844919b0e6c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:20.817730 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f93759c8-4037-4e62-aa73-d844919b0e6c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:20.818212 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f93759c8-4037-4e62-aa73-d844919b0e6c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:20.818993 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f93759c8-4037-4e62-aa73-d844919b0e6c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:20.819430 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f93759c8-4037-4e62-aa73-d844919b0e6c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:20.945349 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-f93759c8-4037-4e62-aa73-d844919b0e6c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:20.952949 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-f93759c8-4037-4e62-aa73-d844919b0e6c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.145964 Dec 15 13:08:20.953509 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 412/890] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:20 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:21.545725 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-55b54060-9e14-413c-9f4a-d6e6d99ee8ec tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:21.546361 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-55b54060-9e14-413c-9f4a-d6e6d99ee8ec tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:21.552214 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-55b54060-9e14-413c-9f4a-d6e6d99ee8ec tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:21.552662 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-55b54060-9e14-413c-9f4a-d6e6d99ee8ec tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:21.553442 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-55b54060-9e14-413c-9f4a-d6e6d99ee8ec tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:21.553879 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-55b54060-9e14-413c-9f4a-d6e6d99ee8ec tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:21.684301 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-55b54060-9e14-413c-9f4a-d6e6d99ee8ec tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:21.691620 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-55b54060-9e14-413c-9f4a-d6e6d99ee8ec tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1677 microversion: 2.1 time: 0.149447 Dec 15 13:08:21.692187 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 479/891] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:21 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:21.813159 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-c24e10af-3021-49b6-95a3-fa7943e96389 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:21.813699 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-c24e10af-3021-49b6-95a3-fa7943e96389 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:21.820484 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c24e10af-3021-49b6-95a3-fa7943e96389 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:21.820935 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c24e10af-3021-49b6-95a3-fa7943e96389 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:21.821712 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c24e10af-3021-49b6-95a3-fa7943e96389 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:21.822171 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c24e10af-3021-49b6-95a3-fa7943e96389 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:21.968604 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4aeb4352-e91e-4765-8816-77b47942ac86 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:21.969381 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4aeb4352-e91e-4765-8816-77b47942ac86 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:21.973979 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-c24e10af-3021-49b6-95a3-fa7943e96389 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:21.975491 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4aeb4352-e91e-4765-8816-77b47942ac86 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:21.975933 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4aeb4352-e91e-4765-8816-77b47942ac86 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:21.976706 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4aeb4352-e91e-4765-8816-77b47942ac86 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:21.977132 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4aeb4352-e91e-4765-8816-77b47942ac86 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:21.981889 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-c24e10af-3021-49b6-95a3-fa7943e96389 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1754 microversion: 2.1 time: 0.172500 Dec 15 13:08:21.982481 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 413/892] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:21 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:22.110820 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4aeb4352-e91e-4765-8816-77b47942ac86 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:22.119423 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4aeb4352-e91e-4765-8816-77b47942ac86 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.154437 Dec 15 13:08:22.120969 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 480/893] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:21 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:08:22.711302 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-4f3f77ee-f249-4b02-b4d0-41bfeadc0c9a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:22.711912 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-4f3f77ee-f249-4b02-b4d0-41bfeadc0c9a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:22.718016 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4f3f77ee-f249-4b02-b4d0-41bfeadc0c9a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:22.718480 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4f3f77ee-f249-4b02-b4d0-41bfeadc0c9a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:22.719854 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4f3f77ee-f249-4b02-b4d0-41bfeadc0c9a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:22.720718 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4f3f77ee-f249-4b02-b4d0-41bfeadc0c9a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:22.881115 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-4f3f77ee-f249-4b02-b4d0-41bfeadc0c9a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:22.888431 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-4f3f77ee-f249-4b02-b4d0-41bfeadc0c9a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1677 microversion: 2.1 time: 0.181075 Dec 15 13:08:22.889218 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 414/894] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:22 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:08:23.007366 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7c896748-cfae-4c9b-887b-64245136d816 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:23.007953 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7c896748-cfae-4c9b-887b-64245136d816 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:23.014585 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7c896748-cfae-4c9b-887b-64245136d816 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:23.015098 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7c896748-cfae-4c9b-887b-64245136d816 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:23.015932 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7c896748-cfae-4c9b-887b-64245136d816 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:23.016448 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7c896748-cfae-4c9b-887b-64245136d816 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:23.137914 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-908bbbb3-0320-46aa-a873-2bc5d4e9cc32 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:23.138571 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-908bbbb3-0320-46aa-a873-2bc5d4e9cc32 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:23.144511 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-908bbbb3-0320-46aa-a873-2bc5d4e9cc32 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:23.144949 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-908bbbb3-0320-46aa-a873-2bc5d4e9cc32 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:23.145729 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-908bbbb3-0320-46aa-a873-2bc5d4e9cc32 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:23.146180 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-908bbbb3-0320-46aa-a873-2bc5d4e9cc32 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:23.166383 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-7c896748-cfae-4c9b-887b-64245136d816 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:23.174741 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7c896748-cfae-4c9b-887b-64245136d816 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1754 microversion: 2.1 time: 0.179643 Dec 15 13:08:23.175318 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 481/895] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:22 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1754 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:23.283572 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-908bbbb3-0320-46aa-a873-2bc5d4e9cc32 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:23.292803 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-908bbbb3-0320-46aa-a873-2bc5d4e9cc32 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1566 microversion: 2.1 time: 0.158431 Dec 15 13:08:23.293363 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 415/896] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:23 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:23.907109 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4a839304-9817-4065-b073-3c5b139500a4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:23.907685 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4a839304-9817-4065-b073-3c5b139500a4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:23.914562 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4a839304-9817-4065-b073-3c5b139500a4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:23.915032 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4a839304-9817-4065-b073-3c5b139500a4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:23.915808 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4a839304-9817-4065-b073-3c5b139500a4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:23.916238 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4a839304-9817-4065-b073-3c5b139500a4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:24.122450 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4a839304-9817-4065-b073-3c5b139500a4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:24.135514 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4a839304-9817-4065-b073-3c5b139500a4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1677 microversion: 2.1 time: 0.232579 Dec 15 13:08:24.136090 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 482/897] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:23 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1677 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:24.192190 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-51ee312a-e17f-4e8b-9883-a232a52b590e tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:24.193346 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-51ee312a-e17f-4e8b-9883-a232a52b590e tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:24.198947 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-51ee312a-e17f-4e8b-9883-a232a52b590e tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:24.199409 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-51ee312a-e17f-4e8b-9883-a232a52b590e tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:24.200756 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-51ee312a-e17f-4e8b-9883-a232a52b590e tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:24.201194 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-51ee312a-e17f-4e8b-9883-a232a52b590e tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:24.310862 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a43052da-6e2d-4bea-a06f-7eccf9d8df8d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:24.311463 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a43052da-6e2d-4bea-a06f-7eccf9d8df8d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:24.317747 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a43052da-6e2d-4bea-a06f-7eccf9d8df8d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:24.318240 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a43052da-6e2d-4bea-a06f-7eccf9d8df8d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:24.319085 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a43052da-6e2d-4bea-a06f-7eccf9d8df8d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:24.319530 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a43052da-6e2d-4bea-a06f-7eccf9d8df8d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:24.387144 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-51ee312a-e17f-4e8b-9883-a232a52b590e tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:24.396044 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-51ee312a-e17f-4e8b-9883-a232a52b590e tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1754 microversion: 2.1 time: 0.207377 Dec 15 13:08:24.396823 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 416/898] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:24 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1754 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:24.469758 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a43052da-6e2d-4bea-a06f-7eccf9d8df8d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:24.477898 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a43052da-6e2d-4bea-a06f-7eccf9d8df8d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1546 microversion: 2.1 time: 0.171477 Dec 15 13:08:24.478496 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 483/899] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:24 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1546 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:08:24.494436 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-d59019ca-7a3d-443c-bf9d-8ce16d061e92 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:24.494926 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-d59019ca-7a3d-443c-bf9d-8ce16d061e92 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:24.501110 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d59019ca-7a3d-443c-bf9d-8ce16d061e92 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:24.501678 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d59019ca-7a3d-443c-bf9d-8ce16d061e92 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:24.502606 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d59019ca-7a3d-443c-bf9d-8ce16d061e92 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:24.503030 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d59019ca-7a3d-443c-bf9d-8ce16d061e92 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:24.582846 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.wsgi [None req-d59019ca-7a3d-443c-bf9d-8ce16d061e92 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] HTTP exception thrown: Cannot 'detach_volume' instance 46358568-c4cc-4dd2-81e7-c724c57ee533 while it is in vm_state rescued Dec 15 13:08:24.583915 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-d59019ca-7a3d-443c-bf9d-8ce16d061e92 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Returning 409 to user: Cannot 'detach_volume' instance 46358568-c4cc-4dd2-81e7-c724c57ee533 while it is in vm_state rescued {{(pid=116097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:08:24.584920 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-d59019ca-7a3d-443c-bf9d-8ce16d061e92 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "DELETE /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments/dbf40fa4-931d-4793-b118-8fbaefdf4767" status: 409 len: 152 microversion: 2.1 time: 0.094057 Dec 15 13:08:24.585471 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 417/900] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Dec 15 13:08:24 2021] DELETE /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments/dbf40fa4-931d-4793-b118-8fbaefdf4767 => generated 152 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 15 13:08:24.594392 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-082a922c-0073-4b07-9832-fb2160671d15 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:08:24.595399 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-082a922c-0073-4b07-9832-fb2160671d15 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:24.601671 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-082a922c-0073-4b07-9832-fb2160671d15 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:24.602194 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-082a922c-0073-4b07-9832-fb2160671d15 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:24.603108 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-082a922c-0073-4b07-9832-fb2160671d15 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:24.603600 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-082a922c-0073-4b07-9832-fb2160671d15 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:24.670251 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-082a922c-0073-4b07-9832-fb2160671d15 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "POST /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/action" status: 202 len: 0 microversion: 2.1 time: 0.079935 Dec 15 13:08:24.670891 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 484/901] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:08:24 2021] POST /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:08:24.679340 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-021df6e2-e940-43f7-a111-f4727395a87b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:24.680463 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-021df6e2-e940-43f7-a111-f4727395a87b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:24.687067 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-021df6e2-e940-43f7-a111-f4727395a87b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:24.687519 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-021df6e2-e940-43f7-a111-f4727395a87b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:24.688342 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-021df6e2-e940-43f7-a111-f4727395a87b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:24.688924 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-021df6e2-e940-43f7-a111-f4727395a87b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:24.829446 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-021df6e2-e940-43f7-a111-f4727395a87b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:24.838386 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-021df6e2-e940-43f7-a111-f4727395a87b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1554 microversion: 2.1 time: 0.163194 Dec 15 13:08:24.839045 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 418/902] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:24 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:25.154280 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a51e840d-4ee8-4c70-a7b0-b88285c9185a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:25.154982 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a51e840d-4ee8-4c70-a7b0-b88285c9185a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:25.161755 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a51e840d-4ee8-4c70-a7b0-b88285c9185a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:25.162235 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a51e840d-4ee8-4c70-a7b0-b88285c9185a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:25.163193 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a51e840d-4ee8-4c70-a7b0-b88285c9185a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:25.163632 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a51e840d-4ee8-4c70-a7b0-b88285c9185a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:25.310721 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a51e840d-4ee8-4c70-a7b0-b88285c9185a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:25.320770 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a51e840d-4ee8-4c70-a7b0-b88285c9185a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1677 microversion: 2.1 time: 0.169597 Dec 15 13:08:25.320770 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 485/903] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:25 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:25.412480 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-659f4896-b099-4686-a53d-25b4e74c833a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:25.413136 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-659f4896-b099-4686-a53d-25b4e74c833a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:25.420005 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-659f4896-b099-4686-a53d-25b4e74c833a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:25.420308 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-659f4896-b099-4686-a53d-25b4e74c833a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:25.421297 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-659f4896-b099-4686-a53d-25b4e74c833a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:25.421820 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-659f4896-b099-4686-a53d-25b4e74c833a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:25.620301 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-659f4896-b099-4686-a53d-25b4e74c833a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:25.629553 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-659f4896-b099-4686-a53d-25b4e74c833a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1754 microversion: 2.1 time: 0.220666 Dec 15 13:08:25.641190 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 419/904] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:25 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1754 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:25.856622 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b6abc22b-11a3-4235-8496-33dd046160ac tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:25.857398 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b6abc22b-11a3-4235-8496-33dd046160ac tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:25.863490 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b6abc22b-11a3-4235-8496-33dd046160ac tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:25.864037 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b6abc22b-11a3-4235-8496-33dd046160ac tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:25.864822 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b6abc22b-11a3-4235-8496-33dd046160ac tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:25.865241 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b6abc22b-11a3-4235-8496-33dd046160ac tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:25.993630 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b6abc22b-11a3-4235-8496-33dd046160ac tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:26.001874 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b6abc22b-11a3-4235-8496-33dd046160ac tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1554 microversion: 2.1 time: 0.150204 Dec 15 13:08:26.002469 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 486/905] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:25 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:26.337937 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-6f6f67e3-05d3-482f-892c-4baf417a5507 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:26.338594 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-6f6f67e3-05d3-482f-892c-4baf417a5507 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:26.344957 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6f6f67e3-05d3-482f-892c-4baf417a5507 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:26.345434 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6f6f67e3-05d3-482f-892c-4baf417a5507 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:26.346230 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6f6f67e3-05d3-482f-892c-4baf417a5507 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:26.346678 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6f6f67e3-05d3-482f-892c-4baf417a5507 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:26.484635 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-6f6f67e3-05d3-482f-892c-4baf417a5507 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:26.496674 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-6f6f67e3-05d3-482f-892c-4baf417a5507 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1677 microversion: 2.1 time: 0.162703 Dec 15 13:08:26.497998 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 420/906] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:26 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:26.647771 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1d1d948a-0ee1-408c-b241-3ac2fdc6c22f tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:26.648383 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1d1d948a-0ee1-408c-b241-3ac2fdc6c22f tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:26.655245 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1d1d948a-0ee1-408c-b241-3ac2fdc6c22f tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:26.655709 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1d1d948a-0ee1-408c-b241-3ac2fdc6c22f tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:26.656485 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1d1d948a-0ee1-408c-b241-3ac2fdc6c22f tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:26.657197 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1d1d948a-0ee1-408c-b241-3ac2fdc6c22f tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:26.826831 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1d1d948a-0ee1-408c-b241-3ac2fdc6c22f tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:26.834578 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1d1d948a-0ee1-408c-b241-3ac2fdc6c22f tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1757 microversion: 2.1 time: 0.190362 Dec 15 13:08:26.835149 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 487/907] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:26 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1757 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:08:27.019391 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-a4be2abb-0ef3-4108-b403-0d0a5b3a9318 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:27.020056 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-a4be2abb-0ef3-4108-b403-0d0a5b3a9318 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:27.025884 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a4be2abb-0ef3-4108-b403-0d0a5b3a9318 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:27.026376 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a4be2abb-0ef3-4108-b403-0d0a5b3a9318 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:27.027207 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a4be2abb-0ef3-4108-b403-0d0a5b3a9318 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:27.028243 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a4be2abb-0ef3-4108-b403-0d0a5b3a9318 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:27.164362 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-a4be2abb-0ef3-4108-b403-0d0a5b3a9318 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:27.172752 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-a4be2abb-0ef3-4108-b403-0d0a5b3a9318 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1554 microversion: 2.1 time: 0.157112 Dec 15 13:08:27.173319 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 421/908] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:27 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:27.515118 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f054c9f6-3541-486a-9181-19b0997b15f4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:27.515720 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f054c9f6-3541-486a-9181-19b0997b15f4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:27.521503 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f054c9f6-3541-486a-9181-19b0997b15f4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:27.521949 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f054c9f6-3541-486a-9181-19b0997b15f4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:27.522753 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f054c9f6-3541-486a-9181-19b0997b15f4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:27.523192 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f054c9f6-3541-486a-9181-19b0997b15f4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:27.657869 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f054c9f6-3541-486a-9181-19b0997b15f4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:27.668891 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f054c9f6-3541-486a-9181-19b0997b15f4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1677 microversion: 2.1 time: 0.157914 Dec 15 13:08:27.669655 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 488/909] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:27 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:28.190357 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-0cbe0edb-0a82-4c31-9948-6cc9a1b49040 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:28.190953 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-0cbe0edb-0a82-4c31-9948-6cc9a1b49040 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:28.197556 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0cbe0edb-0a82-4c31-9948-6cc9a1b49040 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:28.198078 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0cbe0edb-0a82-4c31-9948-6cc9a1b49040 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:28.198895 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0cbe0edb-0a82-4c31-9948-6cc9a1b49040 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:28.199452 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0cbe0edb-0a82-4c31-9948-6cc9a1b49040 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:28.327943 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-0cbe0edb-0a82-4c31-9948-6cc9a1b49040 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:28.335849 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-0cbe0edb-0a82-4c31-9948-6cc9a1b49040 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1554 microversion: 2.1 time: 0.149171 Dec 15 13:08:28.336483 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 422/910] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:28 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:28.689136 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-11985c49-11b4-4167-ae67-2ffc129ccbe4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:28.689960 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-11985c49-11b4-4167-ae67-2ffc129ccbe4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:28.696074 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-11985c49-11b4-4167-ae67-2ffc129ccbe4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:28.696517 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-11985c49-11b4-4167-ae67-2ffc129ccbe4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:28.697282 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-11985c49-11b4-4167-ae67-2ffc129ccbe4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:28.697712 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-11985c49-11b4-4167-ae67-2ffc129ccbe4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:28.844274 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-11985c49-11b4-4167-ae67-2ffc129ccbe4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:28.851782 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-11985c49-11b4-4167-ae67-2ffc129ccbe4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1677 microversion: 2.1 time: 0.166293 Dec 15 13:08:28.852324 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 489/911] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:28 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:29.352872 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-b157abd7-2d7e-43f1-905b-3daca20ef991 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:29.353534 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-b157abd7-2d7e-43f1-905b-3daca20ef991 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:29.360778 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b157abd7-2d7e-43f1-905b-3daca20ef991 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:29.361224 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b157abd7-2d7e-43f1-905b-3daca20ef991 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:29.361992 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b157abd7-2d7e-43f1-905b-3daca20ef991 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:29.362471 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b157abd7-2d7e-43f1-905b-3daca20ef991 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:29.499299 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-b157abd7-2d7e-43f1-905b-3daca20ef991 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:29.506929 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-b157abd7-2d7e-43f1-905b-3daca20ef991 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1554 microversion: 2.1 time: 0.157738 Dec 15 13:08:29.507484 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 423/912] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:29 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:29.876823 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-60a7bf18-187d-4857-b5e3-3a632f7f5706 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:29.877505 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-60a7bf18-187d-4857-b5e3-3a632f7f5706 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:29.884168 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-60a7bf18-187d-4857-b5e3-3a632f7f5706 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:29.884785 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-60a7bf18-187d-4857-b5e3-3a632f7f5706 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:29.885566 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-60a7bf18-187d-4857-b5e3-3a632f7f5706 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:29.885985 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-60a7bf18-187d-4857-b5e3-3a632f7f5706 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:30.071188 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-60a7bf18-187d-4857-b5e3-3a632f7f5706 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:30.081084 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-60a7bf18-187d-4857-b5e3-3a632f7f5706 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1677 microversion: 2.1 time: 0.212524 Dec 15 13:08:30.081668 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 490/913] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:29 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1677 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:08:30.523490 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-c33a2f58-e3f7-4e62-9100-60d418343104 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:30.524101 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-c33a2f58-e3f7-4e62-9100-60d418343104 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:30.530247 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c33a2f58-e3f7-4e62-9100-60d418343104 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:30.530691 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c33a2f58-e3f7-4e62-9100-60d418343104 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:30.531460 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c33a2f58-e3f7-4e62-9100-60d418343104 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:30.531891 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c33a2f58-e3f7-4e62-9100-60d418343104 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:30.657843 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-c33a2f58-e3f7-4e62-9100-60d418343104 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:30.665536 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-c33a2f58-e3f7-4e62-9100-60d418343104 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1560 microversion: 2.1 time: 0.145664 Dec 15 13:08:30.666101 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 424/914] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:30 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:30.731235 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-39700765-ff72-4fc0-9156-a41f3be8dc91 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:30.731720 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-39700765-ff72-4fc0-9156-a41f3be8dc91 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:30.737495 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-39700765-ff72-4fc0-9156-a41f3be8dc91 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:30.737940 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-39700765-ff72-4fc0-9156-a41f3be8dc91 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:30.738731 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-39700765-ff72-4fc0-9156-a41f3be8dc91 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:30.739158 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-39700765-ff72-4fc0-9156-a41f3be8dc91 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:30.833465 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.objects.instance [None req-39700765-ff72-4fc0-9156-a41f3be8dc91 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lazy-loading 'services' on Instance uuid 46358568-c4cc-4dd2-81e7-c724c57ee533 {{(pid=116098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:08:30.906501 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-39700765-ff72-4fc0-9156-a41f3be8dc91 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "DELETE /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments/dbf40fa4-931d-4793-b118-8fbaefdf4767" status: 202 len: 0 microversion: 2.1 time: 0.179377 Dec 15 13:08:30.907235 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 491/915] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Dec 15 13:08:30 2021] DELETE /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments/dbf40fa4-931d-4793-b118-8fbaefdf4767 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:08:30.915471 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-8526e844-ad8b-4634-8e93-9b279acf0c02 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:30.916470 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-8526e844-ad8b-4634-8e93-9b279acf0c02 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:30.923137 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8526e844-ad8b-4634-8e93-9b279acf0c02 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:30.923586 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8526e844-ad8b-4634-8e93-9b279acf0c02 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:30.924362 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8526e844-ad8b-4634-8e93-9b279acf0c02 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:30.924790 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8526e844-ad8b-4634-8e93-9b279acf0c02 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:30.954810 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-8526e844-ad8b-4634-8e93-9b279acf0c02 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043145 Dec 15 13:08:30.955531 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 425/916] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:08:30 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:08:31.104289 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-45b18473-fcc8-44a7-968a-b80cc5593317 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:31.105762 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-45b18473-fcc8-44a7-968a-b80cc5593317 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:31.117621 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-45b18473-fcc8-44a7-968a-b80cc5593317 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:31.118409 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-45b18473-fcc8-44a7-968a-b80cc5593317 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:31.119729 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-45b18473-fcc8-44a7-968a-b80cc5593317 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:31.120258 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-45b18473-fcc8-44a7-968a-b80cc5593317 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:31.306663 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-45b18473-fcc8-44a7-968a-b80cc5593317 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:31.314731 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-45b18473-fcc8-44a7-968a-b80cc5593317 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1677 microversion: 2.1 time: 0.215690 Dec 15 13:08:31.315378 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 492/917] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:31 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1677 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:08:31.971110 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-dc692fae-6946-4071-8f11-cd5a2b7ab424 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:31.972683 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-dc692fae-6946-4071-8f11-cd5a2b7ab424 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:31.979954 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dc692fae-6946-4071-8f11-cd5a2b7ab424 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:31.980400 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dc692fae-6946-4071-8f11-cd5a2b7ab424 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:31.981172 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dc692fae-6946-4071-8f11-cd5a2b7ab424 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:31.981602 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dc692fae-6946-4071-8f11-cd5a2b7ab424 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:32.011991 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-dc692fae-6946-4071-8f11-cd5a2b7ab424 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047332 Dec 15 13:08:32.012540 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 426/918] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:08:31 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:08:32.332439 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a1a75e3c-65f1-4408-84a4-f7176ec422cc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:32.333022 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a1a75e3c-65f1-4408-84a4-f7176ec422cc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:32.339448 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a1a75e3c-65f1-4408-84a4-f7176ec422cc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:32.339894 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a1a75e3c-65f1-4408-84a4-f7176ec422cc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:32.340664 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a1a75e3c-65f1-4408-84a4-f7176ec422cc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:32.341091 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a1a75e3c-65f1-4408-84a4-f7176ec422cc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:32.468194 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a1a75e3c-65f1-4408-84a4-f7176ec422cc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:32.475516 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a1a75e3c-65f1-4408-84a4-f7176ec422cc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1654 microversion: 2.1 time: 0.146789 Dec 15 13:08:32.476081 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 493/919] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:32 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1654 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:32.491832 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-44ff3b0f-39a4-497c-88be-381fd4b1a51a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:08:32.498747 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-44ff3b0f-39a4-497c-88be-381fd4b1a51a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:32.498996 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-44ff3b0f-39a4-497c-88be-381fd4b1a51a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:32.522132 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-44ff3b0f-39a4-497c-88be-381fd4b1a51a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Going to try to start instance {{(pid=116097) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 15 13:08:32.561348 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-44ff3b0f-39a4-497c-88be-381fd4b1a51a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action" status: 202 len: 0 microversion: 2.1 time: 0.072976 Dec 15 13:08:32.561934 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 427/920] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:08:32 2021] POST /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:08:32.570589 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-77ce1ee6-e7c6-4f0c-a4aa-1cba09de30af tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:32.571299 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-77ce1ee6-e7c6-4f0c-a4aa-1cba09de30af tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:32.579731 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-77ce1ee6-e7c6-4f0c-a4aa-1cba09de30af tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:32.580403 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-77ce1ee6-e7c6-4f0c-a4aa-1cba09de30af tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:32.581572 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-77ce1ee6-e7c6-4f0c-a4aa-1cba09de30af tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:32.582319 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-77ce1ee6-e7c6-4f0c-a4aa-1cba09de30af tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:32.835840 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-77ce1ee6-e7c6-4f0c-a4aa-1cba09de30af tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:32.843075 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-77ce1ee6-e7c6-4f0c-a4aa-1cba09de30af tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1663 microversion: 2.1 time: 0.276551 Dec 15 13:08:32.843642 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 494/921] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:32 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1663 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:33.025957 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-8c30a63e-db4a-4b01-9bba-e4ad9a9a6530 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:33.027842 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-8c30a63e-db4a-4b01-9bba-e4ad9a9a6530 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:33.033958 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8c30a63e-db4a-4b01-9bba-e4ad9a9a6530 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:33.034444 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8c30a63e-db4a-4b01-9bba-e4ad9a9a6530 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:33.035355 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8c30a63e-db4a-4b01-9bba-e4ad9a9a6530 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:33.035800 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8c30a63e-db4a-4b01-9bba-e4ad9a9a6530 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:33.065518 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-8c30a63e-db4a-4b01-9bba-e4ad9a9a6530 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045086 Dec 15 13:08:33.066074 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 428/922] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:08:33 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:08:33.861201 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-dc07e553-da4a-469f-aef4-c0f4f15680c8 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:33.861988 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-dc07e553-da4a-469f-aef4-c0f4f15680c8 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:33.869258 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dc07e553-da4a-469f-aef4-c0f4f15680c8 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:33.869801 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dc07e553-da4a-469f-aef4-c0f4f15680c8 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:33.870707 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dc07e553-da4a-469f-aef4-c0f4f15680c8 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:33.871236 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dc07e553-da4a-469f-aef4-c0f4f15680c8 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:34.045887 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-dc07e553-da4a-469f-aef4-c0f4f15680c8 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:34.053798 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-dc07e553-da4a-469f-aef4-c0f4f15680c8 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1667 microversion: 2.1 time: 0.196293 Dec 15 13:08:34.054397 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 495/923] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:33 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1667 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:34.079036 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-212b0618-fe16-4211-9779-5fc47a519ffc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:34.080444 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-212b0618-fe16-4211-9779-5fc47a519ffc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:34.087407 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-212b0618-fe16-4211-9779-5fc47a519ffc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:34.087971 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-212b0618-fe16-4211-9779-5fc47a519ffc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:34.088817 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-212b0618-fe16-4211-9779-5fc47a519ffc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:34.089320 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-212b0618-fe16-4211-9779-5fc47a519ffc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:34.120230 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-212b0618-fe16-4211-9779-5fc47a519ffc tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046890 Dec 15 13:08:34.120919 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 429/924] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:08:34 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:08:35.131482 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5a39a749-311a-4f72-868a-9d7056bda5ab tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:35.132383 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5a39a749-311a-4f72-868a-9d7056bda5ab tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:35.139385 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5a39a749-311a-4f72-868a-9d7056bda5ab tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:35.139834 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5a39a749-311a-4f72-868a-9d7056bda5ab tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:35.140616 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5a39a749-311a-4f72-868a-9d7056bda5ab tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:35.141054 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5a39a749-311a-4f72-868a-9d7056bda5ab tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:35.171733 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5a39a749-311a-4f72-868a-9d7056bda5ab tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043955 Dec 15 13:08:35.172470 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 496/925] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:08:35 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:08:36.184348 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-5528fb00-82a2-45d3-b789-ad1fd5292ff1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:36.185267 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-5528fb00-82a2-45d3-b789-ad1fd5292ff1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:36.194610 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5528fb00-82a2-45d3-b789-ad1fd5292ff1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:36.195096 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5528fb00-82a2-45d3-b789-ad1fd5292ff1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:36.195934 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5528fb00-82a2-45d3-b789-ad1fd5292ff1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:36.196378 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5528fb00-82a2-45d3-b789-ad1fd5292ff1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:36.226517 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-5528fb00-82a2-45d3-b789-ad1fd5292ff1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046325 Dec 15 13:08:36.227069 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 430/926] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:08:36 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:08:37.237906 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ff37eed7-fb60-4dcb-806a-447c0eddde31 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:37.238835 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ff37eed7-fb60-4dcb-806a-447c0eddde31 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:37.245110 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ff37eed7-fb60-4dcb-806a-447c0eddde31 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:37.246475 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ff37eed7-fb60-4dcb-806a-447c0eddde31 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:37.247258 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ff37eed7-fb60-4dcb-806a-447c0eddde31 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:37.248388 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ff37eed7-fb60-4dcb-806a-447c0eddde31 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:37.278963 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ff37eed7-fb60-4dcb-806a-447c0eddde31 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044753 Dec 15 13:08:37.279554 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 497/927] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:08:37 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:08:37.377313 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-3ccccfe5-8cd9-4902-b123-84a91c98503f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:37.377956 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-3ccccfe5-8cd9-4902-b123-84a91c98503f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:37.385068 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3ccccfe5-8cd9-4902-b123-84a91c98503f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:37.385548 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3ccccfe5-8cd9-4902-b123-84a91c98503f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:37.386474 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3ccccfe5-8cd9-4902-b123-84a91c98503f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:37.387045 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3ccccfe5-8cd9-4902-b123-84a91c98503f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:37.416254 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-3ccccfe5-8cd9-4902-b123-84a91c98503f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments/04ae4504-fb56-430a-a43f-e2b354e7822b" status: 200 len: 194 microversion: 2.20 time: 0.043080 Dec 15 13:08:37.416822 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 431/928] 10.222.0.57 () {60 vars in 1453 bytes} [Wed Dec 15 13:08:37 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments/04ae4504-fb56-430a-a43f-e2b354e7822b => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:08:37.476828 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-10ea2c7f-2e09-4c74-a639-b9b7de557d41 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:37.477326 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-10ea2c7f-2e09-4c74-a639-b9b7de557d41 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:37.483595 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-10ea2c7f-2e09-4c74-a639-b9b7de557d41 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:37.484035 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-10ea2c7f-2e09-4c74-a639-b9b7de557d41 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:37.484821 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-10ea2c7f-2e09-4c74-a639-b9b7de557d41 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:37.485244 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-10ea2c7f-2e09-4c74-a639-b9b7de557d41 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:37.561080 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.objects.instance [None req-10ea2c7f-2e09-4c74-a639-b9b7de557d41 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lazy-loading 'services' on Instance uuid 703b5e88-39f0-436c-ac5a-f1701ec4d7c9 {{(pid=116098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:08:37.632832 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-10ea2c7f-2e09-4c74-a639-b9b7de557d41 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "DELETE /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments/04ae4504-fb56-430a-a43f-e2b354e7822b" status: 202 len: 0 microversion: 2.20 time: 0.159415 Dec 15 13:08:37.633575 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 498/929] 10.222.0.57 () {60 vars in 1456 bytes} [Wed Dec 15 13:08:37 2021] DELETE /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments/04ae4504-fb56-430a-a43f-e2b354e7822b => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:08:37.644431 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-9ca7b7f1-3006-4c62-bdeb-b181b2990442 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:37.645455 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-9ca7b7f1-3006-4c62-bdeb-b181b2990442 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:37.657031 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9ca7b7f1-3006-4c62-bdeb-b181b2990442 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:37.657772 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9ca7b7f1-3006-4c62-bdeb-b181b2990442 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:37.660098 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9ca7b7f1-3006-4c62-bdeb-b181b2990442 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:37.661065 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9ca7b7f1-3006-4c62-bdeb-b181b2990442 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:37.707569 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-9ca7b7f1-3006-4c62-bdeb-b181b2990442 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068909 Dec 15 13:08:37.708523 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 432/930] 10.222.0.57 () {60 vars in 1342 bytes} [Wed Dec 15 13:08:37 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:08:38.292522 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e505fcf7-1cab-4d69-a208-0489d32f04fa tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:38.293537 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e505fcf7-1cab-4d69-a208-0489d32f04fa tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:38.301618 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e505fcf7-1cab-4d69-a208-0489d32f04fa tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:38.302198 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e505fcf7-1cab-4d69-a208-0489d32f04fa tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:38.303231 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e505fcf7-1cab-4d69-a208-0489d32f04fa tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:38.304205 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e505fcf7-1cab-4d69-a208-0489d32f04fa tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:38.337392 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e505fcf7-1cab-4d69-a208-0489d32f04fa tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049729 Dec 15 13:08:38.337958 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 499/931] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:08:38 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:08:38.720231 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-35bcb44e-760a-443f-b154-a0ecadef5ceb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:38.721129 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-35bcb44e-760a-443f-b154-a0ecadef5ceb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:38.727756 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-35bcb44e-760a-443f-b154-a0ecadef5ceb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:38.728205 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-35bcb44e-760a-443f-b154-a0ecadef5ceb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:38.728982 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-35bcb44e-760a-443f-b154-a0ecadef5ceb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:38.729411 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-35bcb44e-760a-443f-b154-a0ecadef5ceb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:38.761910 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-35bcb44e-760a-443f-b154-a0ecadef5ceb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045419 Dec 15 13:08:38.762487 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 433/932] 10.222.0.57 () {60 vars in 1342 bytes} [Wed Dec 15 13:08:38 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:08:39.349063 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-757521d0-4cfd-4ba1-8d83-6341b976214c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:39.349896 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-757521d0-4cfd-4ba1-8d83-6341b976214c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:39.356885 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-757521d0-4cfd-4ba1-8d83-6341b976214c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:39.357570 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-757521d0-4cfd-4ba1-8d83-6341b976214c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:39.358798 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-757521d0-4cfd-4ba1-8d83-6341b976214c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:39.359458 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-757521d0-4cfd-4ba1-8d83-6341b976214c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:39.397100 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-757521d0-4cfd-4ba1-8d83-6341b976214c tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051973 Dec 15 13:08:39.397669 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 500/933] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:08:39 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:08:39.774285 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-c54ffc2a-3a5f-4be9-8165-e7762e79fed1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:39.775207 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-c54ffc2a-3a5f-4be9-8165-e7762e79fed1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:39.781845 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c54ffc2a-3a5f-4be9-8165-e7762e79fed1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:39.782327 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c54ffc2a-3a5f-4be9-8165-e7762e79fed1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:39.783099 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c54ffc2a-3a5f-4be9-8165-e7762e79fed1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:39.783562 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c54ffc2a-3a5f-4be9-8165-e7762e79fed1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:39.812478 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-c54ffc2a-3a5f-4be9-8165-e7762e79fed1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042154 Dec 15 13:08:39.813043 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 434/934] 10.222.0.57 () {60 vars in 1342 bytes} [Wed Dec 15 13:08:39 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:08:40.408727 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8acff128-251e-4116-9664-cf59210509d5 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:40.409625 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8acff128-251e-4116-9664-cf59210509d5 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:40.415999 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8acff128-251e-4116-9664-cf59210509d5 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:40.416433 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8acff128-251e-4116-9664-cf59210509d5 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:40.417196 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8acff128-251e-4116-9664-cf59210509d5 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:40.417647 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8acff128-251e-4116-9664-cf59210509d5 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:40.446382 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8acff128-251e-4116-9664-cf59210509d5 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041323 Dec 15 13:08:40.446937 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 501/935] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:08:40 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:08:40.827897 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-c1347c76-ea7a-4d9c-83a3-a646cdee8bd5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:40.828799 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-c1347c76-ea7a-4d9c-83a3-a646cdee8bd5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:40.835104 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c1347c76-ea7a-4d9c-83a3-a646cdee8bd5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:40.835554 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c1347c76-ea7a-4d9c-83a3-a646cdee8bd5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:40.836335 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c1347c76-ea7a-4d9c-83a3-a646cdee8bd5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:40.836772 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c1347c76-ea7a-4d9c-83a3-a646cdee8bd5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:40.865648 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-c1347c76-ea7a-4d9c-83a3-a646cdee8bd5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042118 Dec 15 13:08:40.866212 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 435/936] 10.222.0.57 () {60 vars in 1342 bytes} [Wed Dec 15 13:08:40 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:08:41.457474 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b5809ee1-56e4-491f-a27a-5f9e2eca306d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:41.458410 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b5809ee1-56e4-491f-a27a-5f9e2eca306d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:41.465283 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b5809ee1-56e4-491f-a27a-5f9e2eca306d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:41.465725 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b5809ee1-56e4-491f-a27a-5f9e2eca306d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:41.466525 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b5809ee1-56e4-491f-a27a-5f9e2eca306d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:41.466954 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b5809ee1-56e4-491f-a27a-5f9e2eca306d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:41.495567 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b5809ee1-56e4-491f-a27a-5f9e2eca306d tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041451 Dec 15 13:08:41.496129 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 502/937] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:08:41 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:08:41.876976 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-73000589-9bb4-4a3c-b021-5ab48bb0e2a3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:41.877878 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-73000589-9bb4-4a3c-b021-5ab48bb0e2a3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:41.884272 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-73000589-9bb4-4a3c-b021-5ab48bb0e2a3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:41.884720 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-73000589-9bb4-4a3c-b021-5ab48bb0e2a3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:41.885492 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-73000589-9bb4-4a3c-b021-5ab48bb0e2a3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:41.886455 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-73000589-9bb4-4a3c-b021-5ab48bb0e2a3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:41.914999 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-73000589-9bb4-4a3c-b021-5ab48bb0e2a3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041762 Dec 15 13:08:41.915536 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 436/938] 10.222.0.57 () {60 vars in 1342 bytes} [Wed Dec 15 13:08:41 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:08:42.506775 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-119a3155-b2ac-41d2-b69f-97fce2460dea tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:42.507704 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-119a3155-b2ac-41d2-b69f-97fce2460dea tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:42.514199 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-119a3155-b2ac-41d2-b69f-97fce2460dea tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:42.514647 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-119a3155-b2ac-41d2-b69f-97fce2460dea tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:42.515441 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-119a3155-b2ac-41d2-b69f-97fce2460dea tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:42.515869 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-119a3155-b2ac-41d2-b69f-97fce2460dea tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:42.543675 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-119a3155-b2ac-41d2-b69f-97fce2460dea tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040641 Dec 15 13:08:42.544205 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 503/939] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:08:42 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:08:42.926212 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-01d2c366-be40-4aa4-8e4a-f5982caeb5c3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:42.927121 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-01d2c366-be40-4aa4-8e4a-f5982caeb5c3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:42.933276 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-01d2c366-be40-4aa4-8e4a-f5982caeb5c3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:42.933721 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-01d2c366-be40-4aa4-8e4a-f5982caeb5c3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:42.934588 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-01d2c366-be40-4aa4-8e4a-f5982caeb5c3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:42.935022 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-01d2c366-be40-4aa4-8e4a-f5982caeb5c3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:42.962334 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-01d2c366-be40-4aa4-8e4a-f5982caeb5c3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039867 Dec 15 13:08:42.962864 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 437/940] 10.222.0.57 () {60 vars in 1342 bytes} [Wed Dec 15 13:08:42 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:08:43.554873 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9c56a528-a8b3-4f0b-bba8-d1604e13dc59 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:43.555802 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9c56a528-a8b3-4f0b-bba8-d1604e13dc59 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:43.562339 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9c56a528-a8b3-4f0b-bba8-d1604e13dc59 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:43.562781 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9c56a528-a8b3-4f0b-bba8-d1604e13dc59 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:43.563537 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9c56a528-a8b3-4f0b-bba8-d1604e13dc59 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:43.563963 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9c56a528-a8b3-4f0b-bba8-d1604e13dc59 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:43.592030 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9c56a528-a8b3-4f0b-bba8-d1604e13dc59 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040887 Dec 15 13:08:43.592560 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 504/941] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:08:43 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:08:43.974188 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-c096d173-7eaf-476a-ba9f-e2040b0bb47d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:43.975084 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-c096d173-7eaf-476a-ba9f-e2040b0bb47d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:43.981544 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c096d173-7eaf-476a-ba9f-e2040b0bb47d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:43.981993 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c096d173-7eaf-476a-ba9f-e2040b0bb47d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:43.982795 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c096d173-7eaf-476a-ba9f-e2040b0bb47d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:43.983229 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c096d173-7eaf-476a-ba9f-e2040b0bb47d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:44.014804 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-c096d173-7eaf-476a-ba9f-e2040b0bb47d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044394 Dec 15 13:08:44.015345 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 438/942] 10.222.0.57 () {60 vars in 1342 bytes} [Wed Dec 15 13:08:43 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:08:44.602872 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9e5bd7fb-e71d-4ac2-bcc8-17de1f2f6bcd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:44.603777 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9e5bd7fb-e71d-4ac2-bcc8-17de1f2f6bcd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:44.610221 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9e5bd7fb-e71d-4ac2-bcc8-17de1f2f6bcd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:44.610671 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9e5bd7fb-e71d-4ac2-bcc8-17de1f2f6bcd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:44.611441 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9e5bd7fb-e71d-4ac2-bcc8-17de1f2f6bcd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:44.611874 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9e5bd7fb-e71d-4ac2-bcc8-17de1f2f6bcd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:44.640655 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9e5bd7fb-e71d-4ac2-bcc8-17de1f2f6bcd tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041755 Dec 15 13:08:44.641199 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 505/943] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:08:44 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:08:45.026677 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-c521c452-e6ba-42e9-98d5-776af46c317f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:45.027571 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-c521c452-e6ba-42e9-98d5-776af46c317f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:45.033664 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c521c452-e6ba-42e9-98d5-776af46c317f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:45.034110 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c521c452-e6ba-42e9-98d5-776af46c317f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:45.034899 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c521c452-e6ba-42e9-98d5-776af46c317f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:45.035330 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c521c452-e6ba-42e9-98d5-776af46c317f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:45.063421 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-c521c452-e6ba-42e9-98d5-776af46c317f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040994 Dec 15 13:08:45.063956 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 439/944] 10.222.0.57 () {60 vars in 1342 bytes} [Wed Dec 15 13:08:45 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:08:45.652635 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4326a0a6-2a8f-4a33-8b89-a8ee8d7ba042 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:45.653533 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4326a0a6-2a8f-4a33-8b89-a8ee8d7ba042 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:45.659695 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4326a0a6-2a8f-4a33-8b89-a8ee8d7ba042 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:45.660139 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4326a0a6-2a8f-4a33-8b89-a8ee8d7ba042 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:45.660900 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4326a0a6-2a8f-4a33-8b89-a8ee8d7ba042 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:45.661330 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4326a0a6-2a8f-4a33-8b89-a8ee8d7ba042 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:45.689831 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4326a0a6-2a8f-4a33-8b89-a8ee8d7ba042 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041644 Dec 15 13:08:45.690396 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 506/945] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:08:45 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:08:46.074522 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-70673f5a-87da-4b75-86fa-ccde45740de7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:46.075373 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-70673f5a-87da-4b75-86fa-ccde45740de7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:46.081400 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-70673f5a-87da-4b75-86fa-ccde45740de7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:46.081847 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-70673f5a-87da-4b75-86fa-ccde45740de7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:46.082803 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-70673f5a-87da-4b75-86fa-ccde45740de7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:46.083235 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-70673f5a-87da-4b75-86fa-ccde45740de7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:46.111749 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-70673f5a-87da-4b75-86fa-ccde45740de7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041701 Dec 15 13:08:46.112310 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 440/946] 10.222.0.57 () {60 vars in 1342 bytes} [Wed Dec 15 13:08:46 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:08:46.700599 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e6d64f51-e3b2-47a7-ae3d-e5b372a023b3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:46.701495 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e6d64f51-e3b2-47a7-ae3d-e5b372a023b3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:46.707679 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e6d64f51-e3b2-47a7-ae3d-e5b372a023b3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:46.708124 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e6d64f51-e3b2-47a7-ae3d-e5b372a023b3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:46.708920 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e6d64f51-e3b2-47a7-ae3d-e5b372a023b3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:46.709355 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e6d64f51-e3b2-47a7-ae3d-e5b372a023b3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:46.738524 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e6d64f51-e3b2-47a7-ae3d-e5b372a023b3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041554 Dec 15 13:08:46.739097 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 507/947] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:08:46 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:08:47.122850 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-ab9f8d3b-e64e-4e0b-b935-f37f4dbd2b85 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:47.123667 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-ab9f8d3b-e64e-4e0b-b935-f37f4dbd2b85 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:47.129521 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ab9f8d3b-e64e-4e0b-b935-f37f4dbd2b85 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:47.129971 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ab9f8d3b-e64e-4e0b-b935-f37f4dbd2b85 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:47.130773 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ab9f8d3b-e64e-4e0b-b935-f37f4dbd2b85 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:47.131212 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ab9f8d3b-e64e-4e0b-b935-f37f4dbd2b85 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:47.159992 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-ab9f8d3b-e64e-4e0b-b935-f37f4dbd2b85 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041011 Dec 15 13:08:47.160527 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 441/948] 10.222.0.57 () {60 vars in 1342 bytes} [Wed Dec 15 13:08:47 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:08:47.750315 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e9c8a739-e263-4f62-b040-f202686ad75f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:47.751215 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e9c8a739-e263-4f62-b040-f202686ad75f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:47.757366 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e9c8a739-e263-4f62-b040-f202686ad75f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:47.757816 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e9c8a739-e263-4f62-b040-f202686ad75f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:47.758617 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e9c8a739-e263-4f62-b040-f202686ad75f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:47.759050 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e9c8a739-e263-4f62-b040-f202686ad75f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:47.786802 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e9c8a739-e263-4f62-b040-f202686ad75f tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040281 Dec 15 13:08:47.787349 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 508/949] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:08:47 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:08:48.173203 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-68d9f8fb-a93b-49fd-ab27-5306ecacc02b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:48.174131 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-68d9f8fb-a93b-49fd-ab27-5306ecacc02b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:48.180289 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-68d9f8fb-a93b-49fd-ab27-5306ecacc02b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:48.180744 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-68d9f8fb-a93b-49fd-ab27-5306ecacc02b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:48.181518 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-68d9f8fb-a93b-49fd-ab27-5306ecacc02b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:48.181957 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-68d9f8fb-a93b-49fd-ab27-5306ecacc02b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:48.210695 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-68d9f8fb-a93b-49fd-ab27-5306ecacc02b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041261 Dec 15 13:08:48.211246 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 442/950] 10.222.0.57 () {60 vars in 1342 bytes} [Wed Dec 15 13:08:48 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:08:48.798041 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ff048164-a855-4674-be18-a5146ef6000e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:48.798980 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ff048164-a855-4674-be18-a5146ef6000e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:48.805110 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ff048164-a855-4674-be18-a5146ef6000e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:48.805554 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ff048164-a855-4674-be18-a5146ef6000e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:48.806340 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ff048164-a855-4674-be18-a5146ef6000e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:48.806770 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ff048164-a855-4674-be18-a5146ef6000e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:48.835972 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ff048164-a855-4674-be18-a5146ef6000e tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041679 Dec 15 13:08:48.836513 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 509/951] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:08:48 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:08:49.223065 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-f37e42f2-21e4-4339-ad46-02ec8fc15272 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:49.223966 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-f37e42f2-21e4-4339-ad46-02ec8fc15272 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:49.230657 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f37e42f2-21e4-4339-ad46-02ec8fc15272 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:49.231104 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f37e42f2-21e4-4339-ad46-02ec8fc15272 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:49.231881 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f37e42f2-21e4-4339-ad46-02ec8fc15272 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:49.232316 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f37e42f2-21e4-4339-ad46-02ec8fc15272 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:49.261329 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-f37e42f2-21e4-4339-ad46-02ec8fc15272 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042229 Dec 15 13:08:49.261875 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 443/952] 10.222.0.57 () {60 vars in 1342 bytes} [Wed Dec 15 13:08:49 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:08:49.846673 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-fea225d7-ec24-4014-9599-0802b76206ce tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:49.847574 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-fea225d7-ec24-4014-9599-0802b76206ce tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:49.853729 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fea225d7-ec24-4014-9599-0802b76206ce tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:49.854720 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fea225d7-ec24-4014-9599-0802b76206ce tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:49.855488 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fea225d7-ec24-4014-9599-0802b76206ce tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:49.855921 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fea225d7-ec24-4014-9599-0802b76206ce tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:49.884179 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-fea225d7-ec24-4014-9599-0802b76206ce tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041277 Dec 15 13:08:49.884728 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 510/953] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:08:49 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:08:50.273012 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-a49248fe-eb3b-4c1b-a515-ee9b7032294c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:50.273910 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-a49248fe-eb3b-4c1b-a515-ee9b7032294c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:50.280535 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a49248fe-eb3b-4c1b-a515-ee9b7032294c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:50.280981 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a49248fe-eb3b-4c1b-a515-ee9b7032294c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:50.281748 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a49248fe-eb3b-4c1b-a515-ee9b7032294c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:50.282207 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a49248fe-eb3b-4c1b-a515-ee9b7032294c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:50.311982 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-a49248fe-eb3b-4c1b-a515-ee9b7032294c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042732 Dec 15 13:08:50.312527 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 444/954] 10.222.0.57 () {60 vars in 1342 bytes} [Wed Dec 15 13:08:50 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:08:50.895851 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4e8e46a6-99a1-42d0-954c-775332f8adb4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:50.896786 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4e8e46a6-99a1-42d0-954c-775332f8adb4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:50.903667 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4e8e46a6-99a1-42d0-954c-775332f8adb4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:50.904114 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4e8e46a6-99a1-42d0-954c-775332f8adb4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:50.904882 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4e8e46a6-99a1-42d0-954c-775332f8adb4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:50.905328 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4e8e46a6-99a1-42d0-954c-775332f8adb4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:50.935014 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4e8e46a6-99a1-42d0-954c-775332f8adb4 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042931 Dec 15 13:08:50.935554 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 511/955] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:08:50 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:08:51.323609 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-507d6e5b-0e6c-4f81-9bfc-63bfcc8f50cf tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:51.324546 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-507d6e5b-0e6c-4f81-9bfc-63bfcc8f50cf tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:51.330760 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-507d6e5b-0e6c-4f81-9bfc-63bfcc8f50cf tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:51.331210 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-507d6e5b-0e6c-4f81-9bfc-63bfcc8f50cf tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:51.331985 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-507d6e5b-0e6c-4f81-9bfc-63bfcc8f50cf tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:51.332421 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-507d6e5b-0e6c-4f81-9bfc-63bfcc8f50cf tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:51.360528 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-507d6e5b-0e6c-4f81-9bfc-63bfcc8f50cf tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041286 Dec 15 13:08:51.361065 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 445/956] 10.222.0.57 () {60 vars in 1342 bytes} [Wed Dec 15 13:08:51 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:08:51.946037 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f3b3272c-747f-4baf-b16a-3ad81e5c98be tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:51.946974 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f3b3272c-747f-4baf-b16a-3ad81e5c98be tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:51.953715 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f3b3272c-747f-4baf-b16a-3ad81e5c98be tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:51.954167 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f3b3272c-747f-4baf-b16a-3ad81e5c98be tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:51.954955 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f3b3272c-747f-4baf-b16a-3ad81e5c98be tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:51.955380 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f3b3272c-747f-4baf-b16a-3ad81e5c98be tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:51.983232 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f3b3272c-747f-4baf-b16a-3ad81e5c98be tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040830 Dec 15 13:08:51.983781 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 512/957] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:08:51 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:08:52.372680 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-1bffb3da-ad9b-40a5-9174-1ad2a723becb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:52.373491 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-1bffb3da-ad9b-40a5-9174-1ad2a723becb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:52.379740 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1bffb3da-ad9b-40a5-9174-1ad2a723becb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:52.380189 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1bffb3da-ad9b-40a5-9174-1ad2a723becb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:52.380960 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1bffb3da-ad9b-40a5-9174-1ad2a723becb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:52.381398 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1bffb3da-ad9b-40a5-9174-1ad2a723becb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:52.409723 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-1bffb3da-ad9b-40a5-9174-1ad2a723becb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041518 Dec 15 13:08:52.410296 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 446/958] 10.222.0.57 () {60 vars in 1342 bytes} [Wed Dec 15 13:08:52 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:08:52.994415 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e951daf9-a5ff-4091-a7f8-c4bee7a91af0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:52.995321 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e951daf9-a5ff-4091-a7f8-c4bee7a91af0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:53.001436 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e951daf9-a5ff-4091-a7f8-c4bee7a91af0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:53.001888 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e951daf9-a5ff-4091-a7f8-c4bee7a91af0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:53.002702 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e951daf9-a5ff-4091-a7f8-c4bee7a91af0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:53.003139 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e951daf9-a5ff-4091-a7f8-c4bee7a91af0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:53.034837 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e951daf9-a5ff-4091-a7f8-c4bee7a91af0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043804 Dec 15 13:08:53.035237 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 513/959] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:08:52 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 13:08:53.420794 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-5af240cf-4180-49de-8471-ee4c340ad16c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:53.421718 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-5af240cf-4180-49de-8471-ee4c340ad16c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:53.428056 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5af240cf-4180-49de-8471-ee4c340ad16c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:53.428313 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5af240cf-4180-49de-8471-ee4c340ad16c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:53.429103 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5af240cf-4180-49de-8471-ee4c340ad16c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:53.429545 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5af240cf-4180-49de-8471-ee4c340ad16c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:53.463055 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-5af240cf-4180-49de-8471-ee4c340ad16c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045806 Dec 15 13:08:53.463465 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 447/960] 10.222.0.57 () {60 vars in 1342 bytes} [Wed Dec 15 13:08:53 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:08:54.474116 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5fe7ec75-28aa-451c-802a-7acb9fac98b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:54.477597 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5fe7ec75-28aa-451c-802a-7acb9fac98b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:54.488274 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5fe7ec75-28aa-451c-802a-7acb9fac98b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:54.488726 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5fe7ec75-28aa-451c-802a-7acb9fac98b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:54.489513 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5fe7ec75-28aa-451c-802a-7acb9fac98b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:54.489946 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5fe7ec75-28aa-451c-802a-7acb9fac98b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:54.534588 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5fe7ec75-28aa-451c-802a-7acb9fac98b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.064278 Dec 15 13:08:54.536011 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 514/961] 10.222.0.57 () {60 vars in 1342 bytes} [Wed Dec 15 13:08:54 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:08:54.609903 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-dbe0ddb1-ff44-4697-916b-640a4dd87af2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:54.610559 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-dbe0ddb1-ff44-4697-916b-640a4dd87af2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:54.621492 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dbe0ddb1-ff44-4697-916b-640a4dd87af2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:54.622507 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dbe0ddb1-ff44-4697-916b-640a4dd87af2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:54.624681 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dbe0ddb1-ff44-4697-916b-640a4dd87af2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:54.626105 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dbe0ddb1-ff44-4697-916b-640a4dd87af2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:54.661168 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-dbe0ddb1-ff44-4697-916b-640a4dd87af2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Going to try to terminate instance {{(pid=116097) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:08:54.764740 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-dbe0ddb1-ff44-4697-916b-640a4dd87af2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "DELETE /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 204 len: 0 microversion: 2.20 time: 0.159166 Dec 15 13:08:54.765633 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 448/962] 10.222.0.57 () {60 vars in 1279 bytes} [Wed Dec 15 13:08:54 2021] DELETE /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 13:08:54.777725 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c35852fe-60d5-4fbd-9598-b3130ff6d881 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:54.777725 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c35852fe-60d5-4fbd-9598-b3130ff6d881 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:54.783296 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c35852fe-60d5-4fbd-9598-b3130ff6d881 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:54.783744 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c35852fe-60d5-4fbd-9598-b3130ff6d881 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:54.784532 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c35852fe-60d5-4fbd-9598-b3130ff6d881 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:54.784967 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c35852fe-60d5-4fbd-9598-b3130ff6d881 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:54.984953 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c35852fe-60d5-4fbd-9598-b3130ff6d881 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:54.999667 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c35852fe-60d5-4fbd-9598-b3130ff6d881 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:55.002061 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c35852fe-60d5-4fbd-9598-b3130ff6d881 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:55.004079 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c35852fe-60d5-4fbd-9598-b3130ff6d881 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1722 microversion: 2.20 time: 0.233927 Dec 15 13:08:55.004819 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 515/963] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:08:54 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:08:55.425364 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-0fc95983-a5bc-4037-a10c-6362bcf736e9 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:55.425970 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-0fc95983-a5bc-4037-a10c-6362bcf736e9 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:55.434812 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0fc95983-a5bc-4037-a10c-6362bcf736e9 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:55.435570 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0fc95983-a5bc-4037-a10c-6362bcf736e9 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:55.436443 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0fc95983-a5bc-4037-a10c-6362bcf736e9 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:55.436974 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0fc95983-a5bc-4037-a10c-6362bcf736e9 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:55.471112 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-0fc95983-a5bc-4037-a10c-6362bcf736e9 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Going to try to terminate instance {{(pid=116097) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:08:55.556805 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-0fc95983-a5bc-4037-a10c-6362bcf736e9 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "DELETE /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 204 len: 0 microversion: 2.1 time: 0.136752 Dec 15 13:08:55.557419 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 449/964] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Dec 15 13:08:55 2021] DELETE /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:08:55.566772 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d213844e-4177-4a68-9113-a0c0710227f0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:55.567402 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d213844e-4177-4a68-9113-a0c0710227f0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:55.575358 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d213844e-4177-4a68-9113-a0c0710227f0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:55.575797 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d213844e-4177-4a68-9113-a0c0710227f0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:55.576576 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d213844e-4177-4a68-9113-a0c0710227f0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:55.576998 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d213844e-4177-4a68-9113-a0c0710227f0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:55.707523 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d213844e-4177-4a68-9113-a0c0710227f0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:55.714941 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d213844e-4177-4a68-9113-a0c0710227f0 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1507 microversion: 2.1 time: 0.152606 Dec 15 13:08:55.715501 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 516/965] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:55 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:56.024345 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-fe19c8f0-7eba-4afd-9575-796ea777775f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:56.025273 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-fe19c8f0-7eba-4afd-9575-796ea777775f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:56.032345 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fe19c8f0-7eba-4afd-9575-796ea777775f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:56.032794 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fe19c8f0-7eba-4afd-9575-796ea777775f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:56.033623 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fe19c8f0-7eba-4afd-9575-796ea777775f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:56.034043 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fe19c8f0-7eba-4afd-9575-796ea777775f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:56.171636 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-fe19c8f0-7eba-4afd-9575-796ea777775f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:56.179679 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-fe19c8f0-7eba-4afd-9575-796ea777775f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:56.181567 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-fe19c8f0-7eba-4afd-9575-796ea777775f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:56.182773 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-fe19c8f0-7eba-4afd-9575-796ea777775f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1722 microversion: 2.20 time: 0.162918 Dec 15 13:08:56.183468 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 450/966] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:08:56 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:08:56.732069 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1e55cb1d-5a5a-4e5d-9b9f-78b33846b6a6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:56.732666 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1e55cb1d-5a5a-4e5d-9b9f-78b33846b6a6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:56.738858 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1e55cb1d-5a5a-4e5d-9b9f-78b33846b6a6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:56.739301 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1e55cb1d-5a5a-4e5d-9b9f-78b33846b6a6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:56.740058 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1e55cb1d-5a5a-4e5d-9b9f-78b33846b6a6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:56.740483 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1e55cb1d-5a5a-4e5d-9b9f-78b33846b6a6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:57.149973 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1e55cb1d-5a5a-4e5d-9b9f-78b33846b6a6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:57.157741 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1e55cb1d-5a5a-4e5d-9b9f-78b33846b6a6 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1507 microversion: 2.1 time: 0.429798 Dec 15 13:08:57.158442 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 517/967] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:56 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1507 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:57.200604 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-580d63c9-a6ab-4f49-92ad-d39ea4974652 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:57.201211 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-580d63c9-a6ab-4f49-92ad-d39ea4974652 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:57.207411 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-580d63c9-a6ab-4f49-92ad-d39ea4974652 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:57.207852 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-580d63c9-a6ab-4f49-92ad-d39ea4974652 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:57.208622 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-580d63c9-a6ab-4f49-92ad-d39ea4974652 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:57.209047 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-580d63c9-a6ab-4f49-92ad-d39ea4974652 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:57.355349 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-580d63c9-a6ab-4f49-92ad-d39ea4974652 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:57.363159 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-580d63c9-a6ab-4f49-92ad-d39ea4974652 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:57.364663 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-580d63c9-a6ab-4f49-92ad-d39ea4974652 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:57.365807 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-580d63c9-a6ab-4f49-92ad-d39ea4974652 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1722 microversion: 2.20 time: 0.168980 Dec 15 13:08:57.366583 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 451/968] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:08:57 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:08:58.061694 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-e67f9bea-e846-41b6-bfaa-86e8851eb3eb req-333efe91-ab70-4c90-a118-561a2e53dc38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "703b5e88-39f0-436c-ac5a-f1701ec4d7c9", "name": "network-vif-deleted", "tag": "82fec70a-827b-4ef1-8922-a834a47147e1"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:08:58.063803 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:08:58.063803 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:08:58.072067 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-e67f9bea-e846-41b6-bfaa-86e8851eb3eb req-333efe91-ab70-4c90-a118-561a2e53dc38 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:58.072598 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-e67f9bea-e846-41b6-bfaa-86e8851eb3eb req-333efe91-ab70-4c90-a118-561a2e53dc38 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:58.084091 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-e67f9bea-e846-41b6-bfaa-86e8851eb3eb req-333efe91-ab70-4c90-a118-561a2e53dc38 service nova] Creating event network-vif-deleted:82fec70a-827b-4ef1-8922-a834a47147e1 for instance 703b5e88-39f0-436c-ac5a-f1701ec4d7c9 on hv-cinder-81322 Dec 15 13:08:58.089819 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-e67f9bea-e846-41b6-bfaa-86e8851eb3eb req-333efe91-ab70-4c90-a118-561a2e53dc38 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033498 Dec 15 13:08:58.091055 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 518/969] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:08:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:08:58.175311 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-6a9d2b3d-ad6a-441c-9a2c-39dc11e318df tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:58.176534 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-6a9d2b3d-ad6a-441c-9a2c-39dc11e318df tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:58.182738 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6a9d2b3d-ad6a-441c-9a2c-39dc11e318df tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:58.183846 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6a9d2b3d-ad6a-441c-9a2c-39dc11e318df tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:58.184855 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6a9d2b3d-ad6a-441c-9a2c-39dc11e318df tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:58.185286 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6a9d2b3d-ad6a-441c-9a2c-39dc11e318df tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:58.384640 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f137b961-25f6-448b-9c23-d8e1809dea13 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:58.385759 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f137b961-25f6-448b-9c23-d8e1809dea13 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:58.386893 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-6a9d2b3d-ad6a-441c-9a2c-39dc11e318df tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:58.394210 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f137b961-25f6-448b-9c23-d8e1809dea13 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:58.394803 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-6a9d2b3d-ad6a-441c-9a2c-39dc11e318df tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1507 microversion: 2.1 time: 0.223728 Dec 15 13:08:58.394952 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f137b961-25f6-448b-9c23-d8e1809dea13 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:58.395651 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f137b961-25f6-448b-9c23-d8e1809dea13 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:58.396259 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f137b961-25f6-448b-9c23-d8e1809dea13 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:58.405575 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 452/970] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:58 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1507 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:58.431682 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f137b961-25f6-448b-9c23-d8e1809dea13 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:58.432148 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f137b961-25f6-448b-9c23-d8e1809dea13 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:58.432592 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.objects.instance [None req-f137b961-25f6-448b-9c23-d8e1809dea13 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lazy-loading 'fault' on Instance uuid 703b5e88-39f0-436c-ac5a-f1701ec4d7c9 {{(pid=116098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:08:58.491729 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f137b961-25f6-448b-9c23-d8e1809dea13 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:58.499215 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f137b961-25f6-448b-9c23-d8e1809dea13 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:58.500988 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f137b961-25f6-448b-9c23-d8e1809dea13 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:58.502360 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f137b961-25f6-448b-9c23-d8e1809dea13 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 200 len: 1371 microversion: 2.20 time: 0.121856 Dec 15 13:08:58.503428 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 519/971] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:08:58 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 1371 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:08:59.412205 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-740b1693-27a3-43e1-b2b7-c3d75b390cbb tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:59.412813 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-740b1693-27a3-43e1-b2b7-c3d75b390cbb tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:59.419087 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-740b1693-27a3-43e1-b2b7-c3d75b390cbb tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:59.419538 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-740b1693-27a3-43e1-b2b7-c3d75b390cbb tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:59.420318 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-740b1693-27a3-43e1-b2b7-c3d75b390cbb tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:59.420758 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-740b1693-27a3-43e1-b2b7-c3d75b390cbb tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:59.452121 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-740b1693-27a3-43e1-b2b7-c3d75b390cbb tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:59.452566 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-740b1693-27a3-43e1-b2b7-c3d75b390cbb tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:59.453010 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.objects.instance [None req-740b1693-27a3-43e1-b2b7-c3d75b390cbb tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lazy-loading 'fault' on Instance uuid 51ca60f9-e96a-440a-83dc-000777505c22 {{(pid=116097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:08:59.491671 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-740b1693-27a3-43e1-b2b7-c3d75b390cbb tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:59.499868 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-740b1693-27a3-43e1-b2b7-c3d75b390cbb tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1312 microversion: 2.1 time: 0.091315 Dec 15 13:08:59.500427 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 453/972] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:59 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1312 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:59.521278 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-848bda26-adb9-44bd-9b99-c2a1e1ffc256 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:59.522079 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-848bda26-adb9-44bd-9b99-c2a1e1ffc256 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:59.528726 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-848bda26-adb9-44bd-9b99-c2a1e1ffc256 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:59.529166 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-848bda26-adb9-44bd-9b99-c2a1e1ffc256 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:59.529928 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-848bda26-adb9-44bd-9b99-c2a1e1ffc256 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:59.530386 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-848bda26-adb9-44bd-9b99-c2a1e1ffc256 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:59.543443 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-848bda26-adb9-44bd-9b99-c2a1e1ffc256 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] HTTP exception thrown: Instance 703b5e88-39f0-436c-ac5a-f1701ec4d7c9 could not be found. Dec 15 13:08:59.544008 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-848bda26-adb9-44bd-9b99-c2a1e1ffc256 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Returning 404 to user: Instance 703b5e88-39f0-436c-ac5a-f1701ec4d7c9 could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:08:59.544795 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-848bda26-adb9-44bd-9b99-c2a1e1ffc256 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 404 len: 111 microversion: 2.20 time: 0.027350 Dec 15 13:08:59.545304 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 520/973] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:08:59 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:08:59.553630 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-a6e4b89e-c2d1-4408-b67d-1000c4c90bd0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '.version_select at 0x7faf12f8bc10>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:59.557055 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a6e4b89e-c2d1-4408-b67d-1000c4c90bd0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [ff08ed34-95fb-4331-be1b-38d7603f9927] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 15 13:09:00.108831 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-f042059c-1b3f-4273-9350-d7de1a5116af req-f2d84beb-eacc-4fba-adc3-79c7134af5c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51ca60f9-e96a-440a-83dc-000777505c22", "name": "network-vif-deleted", "tag": "ce8f94af-f208-4b78-8ade-7227976a0dfd"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:00.110419 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:09:00.110419 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:09:00.117375 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-f042059c-1b3f-4273-9350-d7de1a5116af req-f2d84beb-eacc-4fba-adc3-79c7134af5c0 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:00.117809 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-f042059c-1b3f-4273-9350-d7de1a5116af req-f2d84beb-eacc-4fba-adc3-79c7134af5c0 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:00.128155 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-f042059c-1b3f-4273-9350-d7de1a5116af req-f2d84beb-eacc-4fba-adc3-79c7134af5c0 service nova] Creating event network-vif-deleted:ce8f94af-f208-4b78-8ade-7227976a0dfd for instance 51ca60f9-e96a-440a-83dc-000777505c22 on hv-cinder-81322 Dec 15 13:09:00.132809 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-f042059c-1b3f-4273-9350-d7de1a5116af req-f2d84beb-eacc-4fba-adc3-79c7134af5c0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028137 Dec 15 13:09:00.133365 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 521/974] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:09:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:09:00.517219 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9b149998-0e1c-457c-a2e3-fba8929bce16 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:00.517836 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9b149998-0e1c-457c-a2e3-fba8929bce16 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:00.523841 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9b149998-0e1c-457c-a2e3-fba8929bce16 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:00.524413 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9b149998-0e1c-457c-a2e3-fba8929bce16 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:00.525026 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9b149998-0e1c-457c-a2e3-fba8929bce16 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:00.525454 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9b149998-0e1c-457c-a2e3-fba8929bce16 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:00.554983 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9b149998-0e1c-457c-a2e3-fba8929bce16 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:00.555421 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9b149998-0e1c-457c-a2e3-fba8929bce16 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:00.555857 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.objects.instance [None req-9b149998-0e1c-457c-a2e3-fba8929bce16 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lazy-loading 'fault' on Instance uuid 51ca60f9-e96a-440a-83dc-000777505c22 {{(pid=116098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:09:00.575491 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO oslo.messaging._drivers.impl_rabbit [None req-a6e4b89e-c2d1-4408-b67d-1000c4c90bd0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [ff08ed34-95fb-4331-be1b-38d7603f9927] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 53998. Dec 15 13:09:00.596503 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-9b149998-0e1c-457c-a2e3-fba8929bce16 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:00.597170 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-a6e4b89e-c2d1-4408-b67d-1000c4c90bd0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1758371020" status: 204 len: 0 microversion: 2.20 time: 1.047215 Dec 15 13:09:00.597770 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 454/975] 10.222.0.57 () {60 vars in 1261 bytes} [Wed Dec 15 13:08:59 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1758371020 => generated 0 bytes in 1048 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 13:09:00.605744 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9b149998-0e1c-457c-a2e3-fba8929bce16 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1312 microversion: 2.1 time: 0.092035 Dec 15 13:09:00.610697 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 522/976] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:00 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:09:01.248778 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-0f6c4d2b-db29-4904-9fa8-0cd6317d74fb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'create', calling method: .version_select at 0x7faf12f83f70>, body: {"keypair": {"name": "tempest-keypair-1092440350"}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:01.264616 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-0f6c4d2b-db29-4904-9fa8-0cd6317d74fb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Getting quotas for project 9fda976fb52842e28027e89e4d6752fe. Resources: {'key_pairs'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:09:01.268564 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-0f6c4d2b-db29-4904-9fa8-0cd6317d74fb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Getting quotas for user a1431bb04bd14db986edcf8931bc2210 and project 9fda976fb52842e28027e89e4d6752fe. Resources: {'key_pairs'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:09:01.568123 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-0f6c4d2b-db29-4904-9fa8-0cd6317d74fb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Getting quotas for project 9fda976fb52842e28027e89e4d6752fe. Resources: {'key_pairs'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:09:01.571720 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-0f6c4d2b-db29-4904-9fa8-0cd6317d74fb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Getting quotas for user a1431bb04bd14db986edcf8931bc2210 and project 9fda976fb52842e28027e89e4d6752fe. Resources: {'key_pairs'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:09:01.584494 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-0f6c4d2b-db29-4904-9fa8-0cd6317d74fb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.340049 Dec 15 13:09:01.585249 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 455/977] 10.222.0.57 () {62 vars in 1198 bytes} [Wed Dec 15 13:09:01 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 341 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 15 13:09:01.622226 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d54c79a3-f221-48a1-aa9a-9ab7b48c6936 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:01.622861 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d54c79a3-f221-48a1-aa9a-9ab7b48c6936 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:01.628723 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d54c79a3-f221-48a1-aa9a-9ab7b48c6936 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:01.629162 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d54c79a3-f221-48a1-aa9a-9ab7b48c6936 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:01.629934 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d54c79a3-f221-48a1-aa9a-9ab7b48c6936 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:01.630391 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d54c79a3-f221-48a1-aa9a-9ab7b48c6936 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:01.650921 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:09:01.653796 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: Wed Dec 15 13:09:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 (ip 10.222.0.57) !!! Dec 15 13:09:01.674387 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d54c79a3-f221-48a1-aa9a-9ab7b48c6936 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:01.675176 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d54c79a3-f221-48a1-aa9a-9ab7b48c6936 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:01.676065 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.objects.instance [None req-d54c79a3-f221-48a1-aa9a-9ab7b48c6936 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lazy-loading 'fault' on Instance uuid 51ca60f9-e96a-440a-83dc-000777505c22 {{(pid=116098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:09:01.720688 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d54c79a3-f221-48a1-aa9a-9ab7b48c6936 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:01.729380 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d54c79a3-f221-48a1-aa9a-9ab7b48c6936 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 200 len: 1312 microversion: 2.1 time: 0.110556 Dec 15 13:09:01.734100 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 523/978] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:01 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 1312 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:02.749993 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-930dc4c5-4188-4584-bbad-52ab5dddbeb1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:02.750622 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-930dc4c5-4188-4584-bbad-52ab5dddbeb1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 51ca60f9-e96a-440a-83dc-000777505c22] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:02.756677 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-930dc4c5-4188-4584-bbad-52ab5dddbeb1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:02.757310 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-930dc4c5-4188-4584-bbad-52ab5dddbeb1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:02.758315 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-930dc4c5-4188-4584-bbad-52ab5dddbeb1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:02.758753 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-930dc4c5-4188-4584-bbad-52ab5dddbeb1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:02.772992 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.wsgi [None req-930dc4c5-4188-4584-bbad-52ab5dddbeb1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] HTTP exception thrown: Instance 51ca60f9-e96a-440a-83dc-000777505c22 could not be found. Dec 15 13:09:02.773822 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-930dc4c5-4188-4584-bbad-52ab5dddbeb1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Returning 404 to user: Instance 51ca60f9-e96a-440a-83dc-000777505c22 could not be found. {{(pid=116097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:09:02.774696 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-930dc4c5-4188-4584-bbad-52ab5dddbeb1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22" status: 404 len: 111 microversion: 2.1 time: 0.028850 Dec 15 13:09:02.778804 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 456/979] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:02 2021] GET /compute/v2.1/servers/51ca60f9-e96a-440a-83dc-000777505c22 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:09:02.783577 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0f7c101c-f274-4916-98db-8d5889a56a48 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:02.784081 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0f7c101c-f274-4916-98db-8d5889a56a48 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:02.790220 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0f7c101c-f274-4916-98db-8d5889a56a48 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:02.790667 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0f7c101c-f274-4916-98db-8d5889a56a48 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:02.791541 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0f7c101c-f274-4916-98db-8d5889a56a48 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:02.792029 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0f7c101c-f274-4916-98db-8d5889a56a48 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:02.820209 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0f7c101c-f274-4916-98db-8d5889a56a48 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Going to try to terminate instance {{(pid=116098) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:09:02.900617 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-0f7c101c-f274-4916-98db-8d5889a56a48 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "DELETE /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 204 len: 0 microversion: 2.1 time: 0.120112 Dec 15 13:09:02.904850 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 524/980] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Dec 15 13:09:02 2021] DELETE /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:09:02.911589 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-d15a8a47-4572-4fa8-ad32-f73df2c453b1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:02.912797 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-d15a8a47-4572-4fa8-ad32-f73df2c453b1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:02.920404 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d15a8a47-4572-4fa8-ad32-f73df2c453b1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:02.921105 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d15a8a47-4572-4fa8-ad32-f73df2c453b1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:02.921905 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d15a8a47-4572-4fa8-ad32-f73df2c453b1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:02.922411 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d15a8a47-4572-4fa8-ad32-f73df2c453b1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:03.119201 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-d15a8a47-4572-4fa8-ad32-f73df2c453b1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:03.129547 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-d15a8a47-4572-4fa8-ad32-f73df2c453b1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.222340 Dec 15 13:09:03.130441 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 457/981] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:02 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:03.169489 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e9838449-27bf-499f-be96-dd466367c995 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-857991454", "imageRef": "67890983-693f-44ed-bdf3-22321abeab26", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d413ab2c-3588-4515-a60e-6c78b767a71d"}], "security_groups": [{"name": "tempest-securitygroup--1131175899"}], "key_name": "tempest-keypair-1092440350", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:03.275674 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.network.neutron [None req-e9838449-27bf-499f-be96-dd466367c995 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] validate_networks() for [('d413ab2c-3588-4515-a60e-6c78b767a71d', None, None, None, None, None)] {{(pid=116098) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:09:03.689856 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-e9838449-27bf-499f-be96-dd466367c995 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Flavor limits 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:09:03.690319 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-e9838449-27bf-499f-be96-dd466367c995 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Image limits 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:09:03.690787 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-e9838449-27bf-499f-be96-dd466367c995 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Flavor pref 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:09:03.691188 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-e9838449-27bf-499f-be96-dd466367c995 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Image pref 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:09:03.691590 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-e9838449-27bf-499f-be96-dd466367c995 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:09:03.700066 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e9838449-27bf-499f-be96-dd466367c995 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:03.700510 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e9838449-27bf-499f-be96-dd466367c995 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:03.701311 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e9838449-27bf-499f-be96-dd466367c995 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:03.701745 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e9838449-27bf-499f-be96-dd466367c995 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:03.718118 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-e9838449-27bf-499f-be96-dd466367c995 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Getting quotas for project 9fda976fb52842e28027e89e4d6752fe. Resources: {'instances', 'cores', 'ram'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:09:03.721966 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-e9838449-27bf-499f-be96-dd466367c995 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Getting quotas for user a1431bb04bd14db986edcf8931bc2210 and project 9fda976fb52842e28027e89e4d6752fe. Resources: {'instances', 'cores', 'ram'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:09:03.732986 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e9838449-27bf-499f-be96-dd466367c995 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Going to run 1 instances... {{(pid=116098) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:09:03.735373 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e9838449-27bf-499f-be96-dd466367c995 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67890983-693f-44ed-bdf3-22321abeab26',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:09:03.781035 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e9838449-27bf-499f-be96-dd466367c995 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.616032 Dec 15 13:09:03.781762 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 525/982] 10.222.0.57 () {62 vars in 1187 bytes} [Wed Dec 15 13:09:03 2021] POST /compute/v2.1/servers => generated 402 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 15 13:09:03.791672 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-c7d173b5-3b5f-4e58-a423-808abc15b963 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:03.792856 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-c7d173b5-3b5f-4e58-a423-808abc15b963 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:03.843514 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-c7d173b5-3b5f-4e58-a423-808abc15b963 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:03.850275 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-c7d173b5-3b5f-4e58-a423-808abc15b963 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:03.851770 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-c7d173b5-3b5f-4e58-a423-808abc15b963 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:03.852861 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-c7d173b5-3b5f-4e58-a423-808abc15b963 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1281 microversion: 2.20 time: 0.065055 Dec 15 13:09:03.853396 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 458/983] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:09:03 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1281 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:09:04.148298 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-316a143e-aa9f-4537-956f-0d24b7099d5b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:04.149017 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-316a143e-aa9f-4537-956f-0d24b7099d5b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:04.157187 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-316a143e-aa9f-4537-956f-0d24b7099d5b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:04.157713 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-316a143e-aa9f-4537-956f-0d24b7099d5b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:04.158634 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-316a143e-aa9f-4537-956f-0d24b7099d5b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:04.159079 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-316a143e-aa9f-4537-956f-0d24b7099d5b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:04.293198 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-316a143e-aa9f-4537-956f-0d24b7099d5b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:04.300733 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-316a143e-aa9f-4537-956f-0d24b7099d5b tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.156714 Dec 15 13:09:04.301299 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 526/984] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:04 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:04.928691 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-2c5e7df5-4015-4304-81c5-c2d52b056a50 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:04.929293 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-2c5e7df5-4015-4304-81c5-c2d52b056a50 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:04.936312 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2c5e7df5-4015-4304-81c5-c2d52b056a50 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:04.936762 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2c5e7df5-4015-4304-81c5-c2d52b056a50 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:04.937608 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2c5e7df5-4015-4304-81c5-c2d52b056a50 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:04.938090 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2c5e7df5-4015-4304-81c5-c2d52b056a50 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:05.004084 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-2c5e7df5-4015-4304-81c5-c2d52b056a50 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:05.013790 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-2c5e7df5-4015-4304-81c5-c2d52b056a50 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:05.018893 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-2c5e7df5-4015-4304-81c5-c2d52b056a50 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:05.020594 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-2c5e7df5-4015-4304-81c5-c2d52b056a50 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1351 microversion: 2.20 time: 0.153435 Dec 15 13:09:05.032420 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 459/985] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:09:04 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1351 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:09:05.319511 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-94625177-0384-4dfd-b9e3-05aaa80100a1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:05.320057 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-94625177-0384-4dfd-b9e3-05aaa80100a1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:05.328212 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-94625177-0384-4dfd-b9e3-05aaa80100a1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:05.328662 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-94625177-0384-4dfd-b9e3-05aaa80100a1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:05.329449 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-94625177-0384-4dfd-b9e3-05aaa80100a1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:05.329874 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-94625177-0384-4dfd-b9e3-05aaa80100a1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:05.547201 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-94625177-0384-4dfd-b9e3-05aaa80100a1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:05.554639 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-94625177-0384-4dfd-b9e3-05aaa80100a1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.238997 Dec 15 13:09:05.555219 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 527/986] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:05 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:06.043801 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-5ce3a3bc-e6b3-4c6d-9624-266f16be92e7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:06.044756 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-5ce3a3bc-e6b3-4c6d-9624-266f16be92e7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:06.058721 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5ce3a3bc-e6b3-4c6d-9624-266f16be92e7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:06.059276 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5ce3a3bc-e6b3-4c6d-9624-266f16be92e7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:06.060079 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5ce3a3bc-e6b3-4c6d-9624-266f16be92e7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:06.060689 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5ce3a3bc-e6b3-4c6d-9624-266f16be92e7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:06.206898 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-5ce3a3bc-e6b3-4c6d-9624-266f16be92e7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:06.216167 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-5ce3a3bc-e6b3-4c6d-9624-266f16be92e7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:06.219090 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-5ce3a3bc-e6b3-4c6d-9624-266f16be92e7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:06.220729 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-5ce3a3bc-e6b3-4c6d-9624-266f16be92e7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1407 microversion: 2.20 time: 0.181609 Dec 15 13:09:06.222063 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 460/987] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:09:06 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:09:06.432639 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-a46a9171-893e-4659-aad4-641c57a2315a req-137fd4a1-526c-495d-aede-656ab1e55e0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5328000e-dd8e-4bff-b035-2114c746691a", "tag": "78004f41-fe9a-4327-8c94-953fab674338"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:06.435461 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:09:06.435461 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:09:06.447789 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-a46a9171-893e-4659-aad4-641c57a2315a req-137fd4a1-526c-495d-aede-656ab1e55e0c service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:06.448259 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-a46a9171-893e-4659-aad4-641c57a2315a req-137fd4a1-526c-495d-aede-656ab1e55e0c service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:06.469207 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-a46a9171-893e-4659-aad4-641c57a2315a req-137fd4a1-526c-495d-aede-656ab1e55e0c service nova] Creating event network-changed:78004f41-fe9a-4327-8c94-953fab674338 for instance 5328000e-dd8e-4bff-b035-2114c746691a on hv-cinder-81322 Dec 15 13:09:06.473891 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-a46a9171-893e-4659-aad4-641c57a2315a req-137fd4a1-526c-495d-aede-656ab1e55e0c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044829 Dec 15 13:09:06.474707 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 528/988] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:09:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:09:06.573239 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-d44b1ab0-67ad-4dde-8b55-f42af7219502 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:06.574081 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-d44b1ab0-67ad-4dde-8b55-f42af7219502 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:06.583218 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d44b1ab0-67ad-4dde-8b55-f42af7219502 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:06.584022 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d44b1ab0-67ad-4dde-8b55-f42af7219502 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:06.585063 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d44b1ab0-67ad-4dde-8b55-f42af7219502 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:06.585705 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d44b1ab0-67ad-4dde-8b55-f42af7219502 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:06.757012 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-d44b1ab0-67ad-4dde-8b55-f42af7219502 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:06.764739 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-d44b1ab0-67ad-4dde-8b55-f42af7219502 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.196609 Dec 15 13:09:06.765291 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 461/989] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:06 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:09:07.240539 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-66f3751f-c119-44da-8a94-ecf237cae14a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:07.241762 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-66f3751f-c119-44da-8a94-ecf237cae14a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:07.248648 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-66f3751f-c119-44da-8a94-ecf237cae14a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:07.249425 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-66f3751f-c119-44da-8a94-ecf237cae14a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:07.250055 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-66f3751f-c119-44da-8a94-ecf237cae14a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:07.250477 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-66f3751f-c119-44da-8a94-ecf237cae14a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:07.625792 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-66f3751f-c119-44da-8a94-ecf237cae14a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:07.633924 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-66f3751f-c119-44da-8a94-ecf237cae14a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:07.635436 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-66f3751f-c119-44da-8a94-ecf237cae14a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:07.636517 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-66f3751f-c119-44da-8a94-ecf237cae14a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1407 microversion: 2.20 time: 0.400410 Dec 15 13:09:07.637080 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 529/990] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:09:07 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1407 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:09:07.781088 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-1100a926-7f72-4562-815b-475eccb9f9a3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:07.781843 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-1100a926-7f72-4562-815b-475eccb9f9a3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:07.788305 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1100a926-7f72-4562-815b-475eccb9f9a3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:07.788854 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1100a926-7f72-4562-815b-475eccb9f9a3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:07.789923 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1100a926-7f72-4562-815b-475eccb9f9a3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:07.790997 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1100a926-7f72-4562-815b-475eccb9f9a3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:07.926558 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-1100a926-7f72-4562-815b-475eccb9f9a3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:07.934259 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-1100a926-7f72-4562-815b-475eccb9f9a3 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.157570 Dec 15 13:09:07.934831 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 462/991] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:07 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:08.656412 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-76870066-1032-4378-843c-ae40972b1468 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:08.656999 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-76870066-1032-4378-843c-ae40972b1468 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:08.665274 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76870066-1032-4378-843c-ae40972b1468 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:08.666272 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76870066-1032-4378-843c-ae40972b1468 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:08.666751 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76870066-1032-4378-843c-ae40972b1468 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:08.667831 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76870066-1032-4378-843c-ae40972b1468 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:08.809057 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-76870066-1032-4378-843c-ae40972b1468 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:08.817934 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-76870066-1032-4378-843c-ae40972b1468 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:08.819633 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-76870066-1032-4378-843c-ae40972b1468 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:08.820587 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-76870066-1032-4378-843c-ae40972b1468 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1407 microversion: 2.20 time: 0.169441 Dec 15 13:09:08.821129 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 530/992] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:09:08 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:09:08.951194 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-8d7deaf3-ee6b-40e9-a7ae-bcfe8936c552 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:08.951803 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-8d7deaf3-ee6b-40e9-a7ae-bcfe8936c552 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:08.958172 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8d7deaf3-ee6b-40e9-a7ae-bcfe8936c552 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:08.958635 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8d7deaf3-ee6b-40e9-a7ae-bcfe8936c552 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:08.959409 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8d7deaf3-ee6b-40e9-a7ae-bcfe8936c552 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:08.959963 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8d7deaf3-ee6b-40e9-a7ae-bcfe8936c552 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:09.120626 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-8d7deaf3-ee6b-40e9-a7ae-bcfe8936c552 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:09.128212 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-8d7deaf3-ee6b-40e9-a7ae-bcfe8936c552 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1520 microversion: 2.1 time: 0.180619 Dec 15 13:09:09.128781 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 463/993] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:08 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:09.778635 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-da891971-61ee-4f19-9c87-2af2664d6fad req-df89f0b1-7f36-4525-a8fb-6819c649564e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46358568-c4cc-4dd2-81e7-c724c57ee533", "name": "network-vif-deleted", "tag": "aa929dda-dd0a-496e-be64-c71315b589f5"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:09.780344 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:09:09.780344 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:09:09.788385 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-da891971-61ee-4f19-9c87-2af2664d6fad req-df89f0b1-7f36-4525-a8fb-6819c649564e service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:09.788902 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-da891971-61ee-4f19-9c87-2af2664d6fad req-df89f0b1-7f36-4525-a8fb-6819c649564e service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:09.799740 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-da891971-61ee-4f19-9c87-2af2664d6fad req-df89f0b1-7f36-4525-a8fb-6819c649564e service nova] Creating event network-vif-deleted:aa929dda-dd0a-496e-be64-c71315b589f5 for instance 46358568-c4cc-4dd2-81e7-c724c57ee533 on hv-cinder-81322 Dec 15 13:09:09.804813 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-da891971-61ee-4f19-9c87-2af2664d6fad req-df89f0b1-7f36-4525-a8fb-6819c649564e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029720 Dec 15 13:09:09.805409 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 531/994] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:09:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:09:09.838780 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-7311a3e6-8cb9-4ccb-a167-bd7858988223 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:09.839503 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-7311a3e6-8cb9-4ccb-a167-bd7858988223 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:09.845290 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7311a3e6-8cb9-4ccb-a167-bd7858988223 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:09.845814 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7311a3e6-8cb9-4ccb-a167-bd7858988223 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:09.846727 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7311a3e6-8cb9-4ccb-a167-bd7858988223 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:09.847243 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7311a3e6-8cb9-4ccb-a167-bd7858988223 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:09.983783 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-7311a3e6-8cb9-4ccb-a167-bd7858988223 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:09.992232 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-7311a3e6-8cb9-4ccb-a167-bd7858988223 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:09.995846 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-7311a3e6-8cb9-4ccb-a167-bd7858988223 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:09.997642 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-7311a3e6-8cb9-4ccb-a167-bd7858988223 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1407 microversion: 2.20 time: 0.162329 Dec 15 13:09:09.998352 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 464/995] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:09:09 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:09:10.145116 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5385e8da-5676-485b-ad3d-5888603a59a1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:10.146131 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5385e8da-5676-485b-ad3d-5888603a59a1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:10.152907 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5385e8da-5676-485b-ad3d-5888603a59a1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:10.153999 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5385e8da-5676-485b-ad3d-5888603a59a1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:10.154814 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5385e8da-5676-485b-ad3d-5888603a59a1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:10.155246 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5385e8da-5676-485b-ad3d-5888603a59a1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:10.190833 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5385e8da-5676-485b-ad3d-5888603a59a1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:10.191516 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5385e8da-5676-485b-ad3d-5888603a59a1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:10.192511 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.objects.instance [None req-5385e8da-5676-485b-ad3d-5888603a59a1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lazy-loading 'fault' on Instance uuid 46358568-c4cc-4dd2-81e7-c724c57ee533 {{(pid=116098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:09:10.236970 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5385e8da-5676-485b-ad3d-5888603a59a1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40300c1b04e4f3c9e9063c1d0d47a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d022ad9f948729c91e72aed09c8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:10.245707 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5385e8da-5676-485b-ad3d-5888603a59a1 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 200 len: 1310 microversion: 2.1 time: 0.104172 Dec 15 13:09:10.246817 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 532/996] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:10 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 1310 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:10.704054 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-7c698e51-939d-4933-b893-2da44aa4c5a9 req-af4bea0e-9ec9-4377-8acf-7cd7e0acfa28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5328000e-dd8e-4bff-b035-2114c746691a", "name": "network-vif-plugged", "status": "completed", "tag": "78004f41-fe9a-4327-8c94-953fab674338"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:10.705709 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:09:10.705709 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:09:10.714847 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-7c698e51-939d-4933-b893-2da44aa4c5a9 req-af4bea0e-9ec9-4377-8acf-7cd7e0acfa28 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:10.715289 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-7c698e51-939d-4933-b893-2da44aa4c5a9 req-af4bea0e-9ec9-4377-8acf-7cd7e0acfa28 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:10.726184 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-7c698e51-939d-4933-b893-2da44aa4c5a9 req-af4bea0e-9ec9-4377-8acf-7cd7e0acfa28 service nova] Creating event network-vif-plugged:78004f41-fe9a-4327-8c94-953fab674338 for instance 5328000e-dd8e-4bff-b035-2114c746691a on hv-cinder-81322 Dec 15 13:09:10.731834 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-7c698e51-939d-4933-b893-2da44aa4c5a9 req-af4bea0e-9ec9-4377-8acf-7cd7e0acfa28 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035550 Dec 15 13:09:10.732515 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 465/997] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:09:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:09:11.016277 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-3ef88137-1d5d-45e1-b462-6ab1c6df8981 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:11.016878 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-3ef88137-1d5d-45e1-b462-6ab1c6df8981 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:11.023309 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3ef88137-1d5d-45e1-b462-6ab1c6df8981 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:11.023758 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3ef88137-1d5d-45e1-b462-6ab1c6df8981 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:11.024536 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3ef88137-1d5d-45e1-b462-6ab1c6df8981 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:11.024998 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3ef88137-1d5d-45e1-b462-6ab1c6df8981 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:11.151999 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-3ef88137-1d5d-45e1-b462-6ab1c6df8981 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:11.159651 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-3ef88137-1d5d-45e1-b462-6ab1c6df8981 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:11.161142 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-3ef88137-1d5d-45e1-b462-6ab1c6df8981 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:11.162259 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-3ef88137-1d5d-45e1-b462-6ab1c6df8981 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1407 microversion: 2.20 time: 0.149855 Dec 15 13:09:11.162819 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 533/998] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:09:11 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:09:11.264392 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-1d3ad3fd-febe-4e03-8a18-93c7494f0d45 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:11.265305 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-1d3ad3fd-febe-4e03-8a18-93c7494f0d45 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] [instance: 46358568-c4cc-4dd2-81e7-c724c57ee533] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:11.271240 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1d3ad3fd-febe-4e03-8a18-93c7494f0d45 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:11.271687 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1d3ad3fd-febe-4e03-8a18-93c7494f0d45 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:11.272459 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1d3ad3fd-febe-4e03-8a18-93c7494f0d45 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:11.272890 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1d3ad3fd-febe-4e03-8a18-93c7494f0d45 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:11.287075 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.wsgi [None req-1d3ad3fd-febe-4e03-8a18-93c7494f0d45 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] HTTP exception thrown: Instance 46358568-c4cc-4dd2-81e7-c724c57ee533 could not be found. Dec 15 13:09:11.287656 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-1d3ad3fd-febe-4e03-8a18-93c7494f0d45 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] Returning 404 to user: Instance 46358568-c4cc-4dd2-81e7-c724c57ee533 could not be found. {{(pid=116097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:09:11.288852 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-1d3ad3fd-febe-4e03-8a18-93c7494f0d45 tempest-ServerRescueNegativeTestJSON-649656541 tempest-ServerRescueNegativeTestJSON-649656541-project] 10.222.0.57 "GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533" status: 404 len: 111 microversion: 2.1 time: 0.029451 Dec 15 13:09:11.289409 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 466/999] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:11 2021] GET /compute/v2.1/servers/46358568-c4cc-4dd2-81e7-c724c57ee533 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:09:12.180330 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-cbc6f612-7cc0-4283-aae6-ae3ad6250c90 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:12.180886 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-cbc6f612-7cc0-4283-aae6-ae3ad6250c90 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:12.188126 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cbc6f612-7cc0-4283-aae6-ae3ad6250c90 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:12.188573 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cbc6f612-7cc0-4283-aae6-ae3ad6250c90 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:12.189348 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cbc6f612-7cc0-4283-aae6-ae3ad6250c90 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:12.189783 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cbc6f612-7cc0-4283-aae6-ae3ad6250c90 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:12.418792 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-cbc6f612-7cc0-4283-aae6-ae3ad6250c90 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:12.426468 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-cbc6f612-7cc0-4283-aae6-ae3ad6250c90 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:12.427955 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-cbc6f612-7cc0-4283-aae6-ae3ad6250c90 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:12.429088 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-cbc6f612-7cc0-4283-aae6-ae3ad6250c90 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1598 microversion: 2.20 time: 0.252514 Dec 15 13:09:12.430293 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 534/1000] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:09:12 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1598 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:09:12.447819 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-2f12ab44-d7da-4ffe-89b2-05b8eda0626a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:12.448574 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-2f12ab44-d7da-4ffe-89b2-05b8eda0626a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:12.454741 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2f12ab44-d7da-4ffe-89b2-05b8eda0626a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:12.455194 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2f12ab44-d7da-4ffe-89b2-05b8eda0626a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:12.455960 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2f12ab44-d7da-4ffe-89b2-05b8eda0626a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:12.456391 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2f12ab44-d7da-4ffe-89b2-05b8eda0626a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:12.534192 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-2f12ab44-d7da-4ffe-89b2-05b8eda0626a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090071 Dec 15 13:09:12.534906 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 467/1001] 10.222.0.57 () {60 vars in 1315 bytes} [Wed Dec 15 13:09:12 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:09:13.605831 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-817ecce0-f0bb-47dc-8add-79bc30866e1f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:13.606902 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-817ecce0-f0bb-47dc-8add-79bc30866e1f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:13.611388 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-b577f68a-8e3f-45fa-9c72-8273358b29b3 req-e425bfd0-59a8-42dd-840a-a9e93be4a60a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5328000e-dd8e-4bff-b035-2114c746691a", "tag": "78004f41-fe9a-4327-8c94-953fab674338"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:13.614851 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:09:13.614851 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:09:13.616691 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-817ecce0-f0bb-47dc-8add-79bc30866e1f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:13.617138 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-817ecce0-f0bb-47dc-8add-79bc30866e1f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:13.617992 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-817ecce0-f0bb-47dc-8add-79bc30866e1f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:13.618371 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-817ecce0-f0bb-47dc-8add-79bc30866e1f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:13.626918 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-b577f68a-8e3f-45fa-9c72-8273358b29b3 req-e425bfd0-59a8-42dd-840a-a9e93be4a60a service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:13.627336 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-b577f68a-8e3f-45fa-9c72-8273358b29b3 req-e425bfd0-59a8-42dd-840a-a9e93be4a60a service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:13.653572 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-b577f68a-8e3f-45fa-9c72-8273358b29b3 req-e425bfd0-59a8-42dd-840a-a9e93be4a60a service nova] Creating event network-changed:78004f41-fe9a-4327-8c94-953fab674338 for instance 5328000e-dd8e-4bff-b035-2114c746691a on hv-cinder-81322 Dec 15 13:09:13.664318 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-b577f68a-8e3f-45fa-9c72-8273358b29b3 req-e425bfd0-59a8-42dd-840a-a9e93be4a60a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057726 Dec 15 13:09:13.665252 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 468/1002] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:09:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:09:13.726416 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-817ecce0-f0bb-47dc-8add-79bc30866e1f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 14 microversion: 2.20 time: 0.123814 Dec 15 13:09:13.728451 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 535/1003] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:13 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:14.739947 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-a5364f5b-6a41-459c-bbb2-0cbd78fcf36e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:14.740947 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-a5364f5b-6a41-459c-bbb2-0cbd78fcf36e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:14.753491 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a5364f5b-6a41-459c-bbb2-0cbd78fcf36e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:14.754002 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a5364f5b-6a41-459c-bbb2-0cbd78fcf36e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:14.754896 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a5364f5b-6a41-459c-bbb2-0cbd78fcf36e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:14.755325 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a5364f5b-6a41-459c-bbb2-0cbd78fcf36e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:14.828598 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-a5364f5b-6a41-459c-bbb2-0cbd78fcf36e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 14 microversion: 2.20 time: 0.092930 Dec 15 13:09:14.832324 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 469/1004] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:14 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:09:14.942380 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c551364c-34e9-4ff0-a512-e185a32b3e78 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2091972499"}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:14.943653 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c551364c-34e9-4ff0-a512-e185a32b3e78 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:14.951218 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c551364c-34e9-4ff0-a512-e185a32b3e78 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:14.951925 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c551364c-34e9-4ff0-a512-e185a32b3e78 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:14.952929 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c551364c-34e9-4ff0-a512-e185a32b3e78 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:14.954132 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c551364c-34e9-4ff0-a512-e185a32b3e78 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:15.115884 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.network.security_group_api [None req-c551364c-34e9-4ff0-a512-e185a32b3e78 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Removing security group 54a9d2f6-271b-4168-a9b6-6db60024d842 from port 235d69ca-304f-4a79-a570-8c3fd9220dcf Dec 15 13:09:15.493044 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c551364c-34e9-4ff0-a512-e185a32b3e78 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "POST /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e/action" status: 202 len: 0 microversion: 2.1 time: 0.554896 Dec 15 13:09:15.497115 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 536/1005] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:09:14 2021] POST /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:09:15.507574 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-af7217cc-28b0-4f6b-b065-393b2c75f760 req-5cd8e52a-f362-4104-ba75-02419b5b3724 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b62c709-a647-468b-bb79-1e1e20832c1e", "tag": "235d69ca-304f-4a79-a570-8c3fd9220dcf"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:15.513117 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:09:15.513117 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:09:15.529453 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-af7217cc-28b0-4f6b-b065-393b2c75f760 req-5cd8e52a-f362-4104-ba75-02419b5b3724 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:15.530568 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-af7217cc-28b0-4f6b-b065-393b2c75f760 req-5cd8e52a-f362-4104-ba75-02419b5b3724 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:15.548905 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-af7217cc-28b0-4f6b-b065-393b2c75f760 req-5cd8e52a-f362-4104-ba75-02419b5b3724 service nova] Creating event network-changed:235d69ca-304f-4a79-a570-8c3fd9220dcf for instance 5b62c709-a647-468b-bb79-1e1e20832c1e on hv-cinder-81322 Dec 15 13:09:15.556738 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-af7217cc-28b0-4f6b-b065-393b2c75f760 req-5cd8e52a-f362-4104-ba75-02419b5b3724 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053020 Dec 15 13:09:15.558410 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 470/1006] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:09:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:09:15.839104 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4e5e17c6-f5b6-4b10-b4e0-c73e80106cb4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:15.840397 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4e5e17c6-f5b6-4b10-b4e0-c73e80106cb4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:15.852001 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4e5e17c6-f5b6-4b10-b4e0-c73e80106cb4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:15.852460 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4e5e17c6-f5b6-4b10-b4e0-c73e80106cb4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:15.853258 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4e5e17c6-f5b6-4b10-b4e0-c73e80106cb4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:15.853696 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4e5e17c6-f5b6-4b10-b4e0-c73e80106cb4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:15.955638 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4e5e17c6-f5b6-4b10-b4e0-c73e80106cb4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 14 microversion: 2.20 time: 0.119514 Dec 15 13:09:15.957939 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 537/1007] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:15 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:16.128278 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-dde87586-03bf-46f9-b248-451d2498f462 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:16.129246 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-dde87586-03bf-46f9-b248-451d2498f462 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:16.140970 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dde87586-03bf-46f9-b248-451d2498f462 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:16.141419 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dde87586-03bf-46f9-b248-451d2498f462 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:16.142226 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dde87586-03bf-46f9-b248-451d2498f462 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:16.142662 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dde87586-03bf-46f9-b248-451d2498f462 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:16.201293 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-dde87586-03bf-46f9-b248-451d2498f462 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077057 Dec 15 13:09:16.202250 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 471/1008] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:09:16 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:09:16.269154 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-c2317bce-fdcf-41cf-b371-47537a282f4f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:16.273385 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-c2317bce-fdcf-41cf-b371-47537a282f4f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:16.279938 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c2317bce-fdcf-41cf-b371-47537a282f4f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:16.280393 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c2317bce-fdcf-41cf-b371-47537a282f4f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:16.281172 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c2317bce-fdcf-41cf-b371-47537a282f4f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:16.281608 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c2317bce-fdcf-41cf-b371-47537a282f4f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:16.307628 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-c2317bce-fdcf-41cf-b371-47537a282f4f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Going to try to terminate instance {{(pid=116097) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:09:16.393804 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-c2317bce-fdcf-41cf-b371-47537a282f4f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 204 len: 0 microversion: 2.1 time: 0.129399 Dec 15 13:09:16.402433 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 472/1009] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Dec 15 13:09:16 2021] DELETE /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:09:16.402638 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-af9d1a42-7628-45c9-af8f-dafa31c82688 tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] Action: 'create', calling method: .version_select at 0x7faf180434c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1533325076"}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:16.410827 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-7034e78c-4aea-437f-921e-6af8ea699876 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:16.411772 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-7034e78c-4aea-437f-921e-6af8ea699876 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:16.418657 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7034e78c-4aea-437f-921e-6af8ea699876 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:16.419356 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7034e78c-4aea-437f-921e-6af8ea699876 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:16.420147 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7034e78c-4aea-437f-921e-6af8ea699876 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:16.420584 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7034e78c-4aea-437f-921e-6af8ea699876 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:16.559577 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-7034e78c-4aea-437f-921e-6af8ea699876 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:16.567798 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-7034e78c-4aea-437f-921e-6af8ea699876 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1673 microversion: 2.1 time: 0.161117 Dec 15 13:09:16.578162 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 473/1010] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:16 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1673 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:09:16.746330 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-af9d1a42-7628-45c9-af8f-dafa31c82688 tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.486858 Dec 15 13:09:16.746947 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 538/1011] 10.222.0.57 () {60 vars in 1154 bytes} [Wed Dec 15 13:09:16 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 489 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 15 13:09:16.757527 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-b265d883-bd83-4e6b-9842-834b0ac04e3a tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] Calling method '.version_select at 0x7faf12fb6550>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:16.815301 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-b265d883-bd83-4e6b-9842-834b0ac04e3a tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/84f4a6f0-418e-4b5c-badf-f92ef2eb8599" status: 200 len: 345 microversion: 2.1 time: 0.061246 Dec 15 13:09:16.815944 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 474/1012] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Dec 15 13:09:16 2021] GET /compute/v2.1/os-volumes/84f4a6f0-418e-4b5c-badf-f92ef2eb8599 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:09:16.968496 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1b3720f7-f472-4e4a-b724-cb49850799b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:16.969495 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1b3720f7-f472-4e4a-b724-cb49850799b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:16.975981 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1b3720f7-f472-4e4a-b724-cb49850799b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:16.976437 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1b3720f7-f472-4e4a-b724-cb49850799b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:16.977233 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1b3720f7-f472-4e4a-b724-cb49850799b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:16.977719 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1b3720f7-f472-4e4a-b724-cb49850799b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:17.044511 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1b3720f7-f472-4e4a-b724-cb49850799b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 14 microversion: 2.20 time: 0.080143 Dec 15 13:09:17.047833 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 539/1013] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:16 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:17.379508 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-76d874ef-fc27-4e85-8ac3-2933127671b3 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:17.380110 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-76d874ef-fc27-4e85-8ac3-2933127671b3 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:17.386811 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-76d874ef-fc27-4e85-8ac3-2933127671b3 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:17.387638 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-76d874ef-fc27-4e85-8ac3-2933127671b3 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:17.388640 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-76d874ef-fc27-4e85-8ac3-2933127671b3 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:17.389157 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-76d874ef-fc27-4e85-8ac3-2933127671b3 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:17.481303 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.objects.instance [None req-76d874ef-fc27-4e85-8ac3-2933127671b3 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lazy-loading 'services' on Instance uuid 5b62c709-a647-468b-bb79-1e1e20832c1e {{(pid=116097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:09:17.559792 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-76d874ef-fc27-4e85-8ac3-2933127671b3 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e/os-volume_attachments/22f5dc69-e609-43f4-aa40-9ab6636aedf9" status: 202 len: 0 microversion: 2.1 time: 0.184024 Dec 15 13:09:17.562448 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 475/1014] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Dec 15 13:09:17 2021] DELETE /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e/os-volume_attachments/22f5dc69-e609-43f4-aa40-9ab6636aedf9 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:09:17.577661 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-90000d23-91c1-402f-9971-a8b9250e9c44 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:17.582375 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-90000d23-91c1-402f-9971-a8b9250e9c44 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:17.598219 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-90000d23-91c1-402f-9971-a8b9250e9c44 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:17.599584 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-90000d23-91c1-402f-9971-a8b9250e9c44 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:17.601112 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-90000d23-91c1-402f-9971-a8b9250e9c44 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:17.601731 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-90000d23-91c1-402f-9971-a8b9250e9c44 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:17.656752 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-9bd08f15-c862-4706-9a37-898155a9f84d req-34e275a2-066e-4930-af62-2bb91d015b88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b62c709-a647-468b-bb79-1e1e20832c1e", "tag": "235d69ca-304f-4a79-a570-8c3fd9220dcf"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:17.658843 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:09:17.658843 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:09:17.667385 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-9bd08f15-c862-4706-9a37-898155a9f84d req-34e275a2-066e-4930-af62-2bb91d015b88 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:17.668095 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-9bd08f15-c862-4706-9a37-898155a9f84d req-34e275a2-066e-4930-af62-2bb91d015b88 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:17.701091 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-90000d23-91c1-402f-9971-a8b9250e9c44 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136078 Dec 15 13:09:17.702422 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 540/1015] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:09:17 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:09:17.704198 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-9bd08f15-c862-4706-9a37-898155a9f84d req-34e275a2-066e-4930-af62-2bb91d015b88 service nova] Creating event network-changed:235d69ca-304f-4a79-a570-8c3fd9220dcf for instance 5b62c709-a647-468b-bb79-1e1e20832c1e on hv-cinder-81322 Dec 15 13:09:17.709517 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-9bd08f15-c862-4706-9a37-898155a9f84d req-34e275a2-066e-4930-af62-2bb91d015b88 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140336 Dec 15 13:09:17.711736 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-40a1c5cd-077a-4cf4-a5a8-689f11357306 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:17.712632 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-40a1c5cd-077a-4cf4-a5a8-689f11357306 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:17.713995 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 476/1016] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:09:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:09:17.725934 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-40a1c5cd-077a-4cf4-a5a8-689f11357306 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:17.726503 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-40a1c5cd-077a-4cf4-a5a8-689f11357306 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:17.727773 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-40a1c5cd-077a-4cf4-a5a8-689f11357306 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:17.729265 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-40a1c5cd-077a-4cf4-a5a8-689f11357306 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:17.828629 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-7b9ffc85-8913-49d2-a040-70bed30fe8fe tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] Calling method '.version_select at 0x7faf1c047790>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:17.877756 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-7b9ffc85-8913-49d2-a040-70bed30fe8fe tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/84f4a6f0-418e-4b5c-badf-f92ef2eb8599" status: 200 len: 346 microversion: 2.1 time: 0.053254 Dec 15 13:09:17.878362 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 477/1017] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Dec 15 13:09:17 2021] GET /compute/v2.1/os-volumes/84f4a6f0-418e-4b5c-badf-f92ef2eb8599 => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:09:17.890133 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-be7625e6-ffaf-4914-980c-66a5c942ab85 tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] Action: 'create', calling method: .version_select at 0x7faf1c0475e0>, body: {"snapshot": {"volume_id": "84f4a6f0-418e-4b5c-badf-f92ef2eb8599", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1809579931"}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:17.937555 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-40a1c5cd-077a-4cf4-a5a8-689f11357306 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:17.954603 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-40a1c5cd-077a-4cf4-a5a8-689f11357306 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1673 microversion: 2.1 time: 0.250508 Dec 15 13:09:17.959735 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 541/1018] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:17 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1673 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:18.057885 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8ba9e53a-f4f3-4f69-80a8-567ecc388faa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:18.059865 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8ba9e53a-f4f3-4f69-80a8-567ecc388faa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:18.073300 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-be7625e6-ffaf-4914-980c-66a5c942ab85 tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] 10.222.0.57 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.186661 Dec 15 13:09:18.074139 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 478/1019] 10.222.0.57 () {60 vars in 1161 bytes} [Wed Dec 15 13:09:17 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:09:18.084062 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-2da43d5a-98ac-4869-b12f-eeeb1f6b68b7 tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] Calling method '.version_select at 0x7faf12fe9700>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:18.087743 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8ba9e53a-f4f3-4f69-80a8-567ecc388faa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:18.088250 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8ba9e53a-f4f3-4f69-80a8-567ecc388faa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:18.089084 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8ba9e53a-f4f3-4f69-80a8-567ecc388faa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:18.089526 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8ba9e53a-f4f3-4f69-80a8-567ecc388faa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:18.121497 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-2da43d5a-98ac-4869-b12f-eeeb1f6b68b7 tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/5f9b3342-b7aa-4c31-b51b-c572bd1412b2" status: 200 len: 287 microversion: 2.1 time: 0.041711 Dec 15 13:09:18.128241 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 479/1020] 10.222.0.57 () {58 vars in 1250 bytes} [Wed Dec 15 13:09:18 2021] GET /compute/v2.1/os-snapshots/5f9b3342-b7aa-4c31-b51b-c572bd1412b2 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:09:18.134316 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-755d46b8-98fe-4daa-a8a9-37e26d77581c tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] Calling method '.version_select at 0x7faf12fe93a0>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:18.173000 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-755d46b8-98fe-4daa-a8a9-37e26d77581c tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.043091 Dec 15 13:09:18.173534 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 480/1021] 10.222.0.57 () {58 vars in 1139 bytes} [Wed Dec 15 13:09:18 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:09:18.176064 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8ba9e53a-f4f3-4f69-80a8-567ecc388faa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 14 microversion: 2.20 time: 0.124438 Dec 15 13:09:18.179356 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 542/1022] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:18 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:09:18.183868 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-789e0c3c-ad8e-4bd8-9081-acb90cd2d607 tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] Calling method '.version_select at 0x7faf1c047280>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:18.220728 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-789e0c3c-ad8e-4bd8-9081-acb90cd2d607 tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/5f9b3342-b7aa-4c31-b51b-c572bd1412b2" status: 200 len: 287 microversion: 2.1 time: 0.040616 Dec 15 13:09:18.224909 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 481/1023] 10.222.0.57 () {58 vars in 1250 bytes} [Wed Dec 15 13:09:18 2021] GET /compute/v2.1/os-snapshots/5f9b3342-b7aa-4c31-b51b-c572bd1412b2 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:09:18.714868 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-fc304278-e7c8-401f-8f06-56e9004830e6 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:18.715870 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-fc304278-e7c8-401f-8f06-56e9004830e6 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:18.722920 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fc304278-e7c8-401f-8f06-56e9004830e6 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:18.723204 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fc304278-e7c8-401f-8f06-56e9004830e6 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:18.723991 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fc304278-e7c8-401f-8f06-56e9004830e6 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:18.724426 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fc304278-e7c8-401f-8f06-56e9004830e6 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:18.753963 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-fc304278-e7c8-401f-8f06-56e9004830e6 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043665 Dec 15 13:09:18.754547 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 543/1024] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:09:18 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:09:18.974426 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-54d58b3c-f569-4c53-86f0-09e6ddec6ced tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:18.975311 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-54d58b3c-f569-4c53-86f0-09e6ddec6ced tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:18.982454 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-54d58b3c-f569-4c53-86f0-09e6ddec6ced tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:18.982913 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-54d58b3c-f569-4c53-86f0-09e6ddec6ced tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:18.983996 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-54d58b3c-f569-4c53-86f0-09e6ddec6ced tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:18.984435 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-54d58b3c-f569-4c53-86f0-09e6ddec6ced tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:19.120528 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-54d58b3c-f569-4c53-86f0-09e6ddec6ced tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:19.127857 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-54d58b3c-f569-4c53-86f0-09e6ddec6ced tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1673 microversion: 2.1 time: 0.159631 Dec 15 13:09:19.128416 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 482/1025] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:18 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:09:19.186882 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-23b61320-6f8f-45b1-b936-1b1dd9c5444e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:19.187797 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-23b61320-6f8f-45b1-b936-1b1dd9c5444e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:19.193959 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-23b61320-6f8f-45b1-b936-1b1dd9c5444e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:19.194427 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-23b61320-6f8f-45b1-b936-1b1dd9c5444e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:19.195198 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-23b61320-6f8f-45b1-b936-1b1dd9c5444e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:19.195630 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-23b61320-6f8f-45b1-b936-1b1dd9c5444e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:19.232692 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-01e764b6-086c-4682-ab29-f2db1495909a tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] Calling method '.version_select at 0x7faf12fe9b80>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:19.260819 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-01e764b6-086c-4682-ab29-f2db1495909a tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/5f9b3342-b7aa-4c31-b51b-c572bd1412b2" status: 200 len: 287 microversion: 2.1 time: 0.032134 Dec 15 13:09:19.261360 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 483/1026] 10.222.0.57 () {58 vars in 1250 bytes} [Wed Dec 15 13:09:19 2021] GET /compute/v2.1/os-snapshots/5f9b3342-b7aa-4c31-b51b-c572bd1412b2 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:09:19.766207 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-5ccefec2-79ba-4e36-af5d-e40ef379c8bb tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:19.767193 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-5ccefec2-79ba-4e36-af5d-e40ef379c8bb tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:19.773128 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5ccefec2-79ba-4e36-af5d-e40ef379c8bb tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:19.773571 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5ccefec2-79ba-4e36-af5d-e40ef379c8bb tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:19.774364 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5ccefec2-79ba-4e36-af5d-e40ef379c8bb tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:19.774797 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5ccefec2-79ba-4e36-af5d-e40ef379c8bb tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:19.802724 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-5ccefec2-79ba-4e36-af5d-e40ef379c8bb tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040537 Dec 15 13:09:19.803261 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 484/1027] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:09:19 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:09:20.145483 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-553cbbef-6941-481f-98a2-e9a320b3fa79 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:20.146102 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-553cbbef-6941-481f-98a2-e9a320b3fa79 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:20.152752 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-553cbbef-6941-481f-98a2-e9a320b3fa79 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:20.153216 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-553cbbef-6941-481f-98a2-e9a320b3fa79 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:20.153968 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-553cbbef-6941-481f-98a2-e9a320b3fa79 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:20.154425 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-553cbbef-6941-481f-98a2-e9a320b3fa79 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:20.281552 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-553cbbef-6941-481f-98a2-e9a320b3fa79 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:20.288800 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-553cbbef-6941-481f-98a2-e9a320b3fa79 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1673 microversion: 2.1 time: 0.147019 Dec 15 13:09:20.289363 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 485/1028] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:20 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:20.294442 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-b4c9530a-6628-4e30-9f2c-709f9b5d6b1b tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] Calling method '.version_select at 0x7faf181071f0>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:20.321860 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-b4c9530a-6628-4e30-9f2c-709f9b5d6b1b tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/5f9b3342-b7aa-4c31-b51b-c572bd1412b2" status: 200 len: 287 microversion: 2.1 time: 0.031436 Dec 15 13:09:20.322433 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 486/1029] 10.222.0.57 () {58 vars in 1250 bytes} [Wed Dec 15 13:09:20 2021] GET /compute/v2.1/os-snapshots/5f9b3342-b7aa-4c31-b51b-c572bd1412b2 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:09:20.814237 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-13a0cebd-3123-4fc5-9768-6bb679c9e96f tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:20.814976 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-13a0cebd-3123-4fc5-9768-6bb679c9e96f tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:20.820824 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-13a0cebd-3123-4fc5-9768-6bb679c9e96f tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:20.821273 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-13a0cebd-3123-4fc5-9768-6bb679c9e96f tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:20.822045 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-13a0cebd-3123-4fc5-9768-6bb679c9e96f tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:20.823010 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-13a0cebd-3123-4fc5-9768-6bb679c9e96f tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:20.851100 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-13a0cebd-3123-4fc5-9768-6bb679c9e96f tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040878 Dec 15 13:09:20.851642 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 487/1030] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:09:20 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:09:21.075049 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-23b61320-6f8f-45b1-b936-1b1dd9c5444e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 14 microversion: 2.20 time: 1.891470 Dec 15 13:09:21.075710 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 544/1031] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:19 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 14 bytes in 1893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:21.306343 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-a9b7bcfa-a40d-46e9-b88d-636e044dcdaa tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:21.307524 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-a9b7bcfa-a40d-46e9-b88d-636e044dcdaa tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:21.313577 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a9b7bcfa-a40d-46e9-b88d-636e044dcdaa tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:21.314029 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a9b7bcfa-a40d-46e9-b88d-636e044dcdaa tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:21.314834 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a9b7bcfa-a40d-46e9-b88d-636e044dcdaa tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:21.315270 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a9b7bcfa-a40d-46e9-b88d-636e044dcdaa tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:21.333830 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9f5045d3-d42d-4c1b-ad43-59d669cad415 tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] Calling method '.version_select at 0x7faf18043ca0>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:21.366780 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9f5045d3-d42d-4c1b-ad43-59d669cad415 tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/5f9b3342-b7aa-4c31-b51b-c572bd1412b2" status: 200 len: 288 microversion: 2.1 time: 0.036874 Dec 15 13:09:21.369805 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 545/1032] 10.222.0.57 () {58 vars in 1250 bytes} [Wed Dec 15 13:09:21 2021] GET /compute/v2.1/os-snapshots/5f9b3342-b7aa-4c31-b51b-c572bd1412b2 => generated 288 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:09:21.380862 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-20f79f97-7c5b-4aa6-a241-a5019beca6a4 tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] Calling method '.version_select at 0x7faf1808b040>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:21.464901 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-20f79f97-7c5b-4aa6-a241-a5019beca6a4 tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] 10.222.0.57 "DELETE /compute/v2.1/os-snapshots/5f9b3342-b7aa-4c31-b51b-c572bd1412b2" status: 202 len: 0 microversion: 2.1 time: 0.089341 Dec 15 13:09:21.468505 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 546/1033] 10.222.0.57 () {58 vars in 1253 bytes} [Wed Dec 15 13:09:21 2021] DELETE /compute/v2.1/os-snapshots/5f9b3342-b7aa-4c31-b51b-c572bd1412b2 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:09:21.471207 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-a9b7bcfa-a40d-46e9-b88d-636e044dcdaa tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:21.473497 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-2bab3b2a-97c3-45e3-92c9-127d2ae06aba tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] Calling method '.version_select at 0x7faf180344c0>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:21.479312 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-a9b7bcfa-a40d-46e9-b88d-636e044dcdaa tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1673 microversion: 2.1 time: 0.176114 Dec 15 13:09:21.480302 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 488/1034] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:21 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1673 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:21.503251 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-2bab3b2a-97c3-45e3-92c9-127d2ae06aba tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/5f9b3342-b7aa-4c31-b51b-c572bd1412b2" status: 200 len: 287 microversion: 2.1 time: 0.033436 Dec 15 13:09:21.503973 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 547/1035] 10.222.0.57 () {58 vars in 1250 bytes} [Wed Dec 15 13:09:21 2021] GET /compute/v2.1/os-snapshots/5f9b3342-b7aa-4c31-b51b-c572bd1412b2 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:09:21.862460 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-ce8d19dc-efef-4c36-ae63-9fdac14f2c1b tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:21.863537 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-ce8d19dc-efef-4c36-ae63-9fdac14f2c1b tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:21.869489 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ce8d19dc-efef-4c36-ae63-9fdac14f2c1b tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:21.869863 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ce8d19dc-efef-4c36-ae63-9fdac14f2c1b tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:21.870680 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ce8d19dc-efef-4c36-ae63-9fdac14f2c1b tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:21.871114 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ce8d19dc-efef-4c36-ae63-9fdac14f2c1b tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:21.899753 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-ce8d19dc-efef-4c36-ae63-9fdac14f2c1b tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041240 Dec 15 13:09:21.900963 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 489/1036] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:09:21 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:09:21.910996 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-be24b4c8-7fc8-4437-bcec-72e7d0ed2736 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:21.911652 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-be24b4c8-7fc8-4437-bcec-72e7d0ed2736 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:21.918971 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be24b4c8-7fc8-4437-bcec-72e7d0ed2736 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:21.919516 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be24b4c8-7fc8-4437-bcec-72e7d0ed2736 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:21.920303 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be24b4c8-7fc8-4437-bcec-72e7d0ed2736 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:21.920748 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be24b4c8-7fc8-4437-bcec-72e7d0ed2736 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:21.996878 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-be24b4c8-7fc8-4437-bcec-72e7d0ed2736 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] HTTP exception thrown: Instance 5b62c709-a647-468b-bb79-1e1e20832c1e is not attached to volume 22f5dc69-e609-43f4-aa40-9ab6636aedf9 Dec 15 13:09:21.997470 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-be24b4c8-7fc8-4437-bcec-72e7d0ed2736 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Returning 404 to user: Instance 5b62c709-a647-468b-bb79-1e1e20832c1e is not attached to volume 22f5dc69-e609-43f4-aa40-9ab6636aedf9 {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:09:21.998330 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-be24b4c8-7fc8-4437-bcec-72e7d0ed2736 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e/os-volume_attachments/22f5dc69-e609-43f4-aa40-9ab6636aedf9" status: 404 len: 154 microversion: 2.1 time: 0.091563 Dec 15 13:09:21.998881 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 548/1037] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Dec 15 13:09:21 2021] DELETE /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e/os-volume_attachments/22f5dc69-e609-43f4-aa40-9ab6636aedf9 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:09:22.085958 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-828457a6-e4b1-46a7-b74d-17a49ad96467 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:22.086914 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-828457a6-e4b1-46a7-b74d-17a49ad96467 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:22.093691 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-828457a6-e4b1-46a7-b74d-17a49ad96467 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:22.094769 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-828457a6-e4b1-46a7-b74d-17a49ad96467 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:22.102473 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-828457a6-e4b1-46a7-b74d-17a49ad96467 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:22.103048 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-828457a6-e4b1-46a7-b74d-17a49ad96467 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:22.162754 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-828457a6-e4b1-46a7-b74d-17a49ad96467 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 14 microversion: 2.20 time: 0.080348 Dec 15 13:09:22.163556 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 490/1038] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:22 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:22.251777 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-e8d0d159-1838-432b-8d00-0a3f4923b051 req-ace4b4f0-2ecd-49d1-8c8e-1623681ea4da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d29665f-f416-4d8b-8a0a-7e1eb1515440", "name": "network-vif-deleted", "tag": "290299b4-44f3-4a5d-b1f8-8cd714318502"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:22.253456 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:09:22.253456 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:09:22.266920 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-e8d0d159-1838-432b-8d00-0a3f4923b051 req-ace4b4f0-2ecd-49d1-8c8e-1623681ea4da service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:22.279033 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-e8d0d159-1838-432b-8d00-0a3f4923b051 req-ace4b4f0-2ecd-49d1-8c8e-1623681ea4da service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:22.295183 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-e8d0d159-1838-432b-8d00-0a3f4923b051 req-ace4b4f0-2ecd-49d1-8c8e-1623681ea4da service nova] Creating event network-vif-deleted:290299b4-44f3-4a5d-b1f8-8cd714318502 for instance 8d29665f-f416-4d8b-8a0a-7e1eb1515440 on hv-cinder-81322 Dec 15 13:09:22.300886 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-e8d0d159-1838-432b-8d00-0a3f4923b051 req-ace4b4f0-2ecd-49d1-8c8e-1623681ea4da service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052343 Dec 15 13:09:22.304814 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 549/1039] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:09:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:09:22.501394 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-1ba7beef-5a72-4d0d-88ad-db97473f22f6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:22.502086 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-1ba7beef-5a72-4d0d-88ad-db97473f22f6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:22.508843 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1ba7beef-5a72-4d0d-88ad-db97473f22f6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:22.509500 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1ba7beef-5a72-4d0d-88ad-db97473f22f6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:22.511019 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1ba7beef-5a72-4d0d-88ad-db97473f22f6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:22.511461 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1ba7beef-5a72-4d0d-88ad-db97473f22f6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:22.516447 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f657e1cb-4b19-4efe-bf16-d125fdae4272 tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] Calling method '.version_select at 0x7faf18034a60>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:22.541774 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-f657e1cb-4b19-4efe-bf16-d125fdae4272 tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] HTTP exception thrown: Snapshot 5f9b3342-b7aa-4c31-b51b-c572bd1412b2 could not be found. Dec 15 13:09:22.542577 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f657e1cb-4b19-4efe-bf16-d125fdae4272 tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] Returning 404 to user: Snapshot 5f9b3342-b7aa-4c31-b51b-c572bd1412b2 could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:09:22.543601 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f657e1cb-4b19-4efe-bf16-d125fdae4272 tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/5f9b3342-b7aa-4c31-b51b-c572bd1412b2" status: 404 len: 111 microversion: 2.1 time: 0.031458 Dec 15 13:09:22.544493 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 550/1040] 10.222.0.57 () {58 vars in 1250 bytes} [Wed Dec 15 13:09:22 2021] GET /compute/v2.1/os-snapshots/5f9b3342-b7aa-4c31-b51b-c572bd1412b2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:09:22.550816 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1ba7beef-5a72-4d0d-88ad-db97473f22f6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:22.551332 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1ba7beef-5a72-4d0d-88ad-db97473f22f6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:22.551797 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.objects.instance [None req-1ba7beef-5a72-4d0d-88ad-db97473f22f6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lazy-loading 'fault' on Instance uuid 8d29665f-f416-4d8b-8a0a-7e1eb1515440 {{(pid=116097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:09:22.552229 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-727c7448-5db4-4f38-9065-0567b41f49b7 tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] Calling method '.version_select at 0x7faf18051790>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:22.593223 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-1ba7beef-5a72-4d0d-88ad-db97473f22f6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:22.600801 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-1ba7beef-5a72-4d0d-88ad-db97473f22f6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 200 len: 1327 microversion: 2.1 time: 0.103495 Dec 15 13:09:22.601365 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 491/1041] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:22 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 1327 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:22.619640 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-727c7448-5db4-4f38-9065-0567b41f49b7 tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/84f4a6f0-418e-4b5c-badf-f92ef2eb8599" status: 202 len: 0 microversion: 2.1 time: 0.070284 Dec 15 13:09:22.620422 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 551/1042] 10.222.0.57 () {58 vars in 1247 bytes} [Wed Dec 15 13:09:22 2021] DELETE /compute/v2.1/os-volumes/84f4a6f0-418e-4b5c-badf-f92ef2eb8599 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:09:22.628805 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-2d27f938-11a7-48cb-9801-d418eadca715 tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] Calling method '.version_select at 0x7faf1806a1f0>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:22.680274 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-2d27f938-11a7-48cb-9801-d418eadca715 tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/84f4a6f0-418e-4b5c-badf-f92ef2eb8599" status: 200 len: 345 microversion: 2.1 time: 0.055491 Dec 15 13:09:22.680921 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 492/1043] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Dec 15 13:09:22 2021] GET /compute/v2.1/os-volumes/84f4a6f0-418e-4b5c-badf-f92ef2eb8599 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:09:23.136113 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9d0bec97-3f16-4e3b-8bca-121e62c5ba5c tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:23.136723 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9d0bec97-3f16-4e3b-8bca-121e62c5ba5c tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:23.142988 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9d0bec97-3f16-4e3b-8bca-121e62c5ba5c tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:23.143435 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9d0bec97-3f16-4e3b-8bca-121e62c5ba5c tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:23.144203 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9d0bec97-3f16-4e3b-8bca-121e62c5ba5c tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:23.144640 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9d0bec97-3f16-4e3b-8bca-121e62c5ba5c tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:23.169227 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9d0bec97-3f16-4e3b-8bca-121e62c5ba5c tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Going to try to terminate instance {{(pid=116098) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:09:23.174424 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-b8b26b48-b2e6-47b2-a5b1-e62a439fddec tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:23.175897 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-b8b26b48-b2e6-47b2-a5b1-e62a439fddec tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:23.184147 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b8b26b48-b2e6-47b2-a5b1-e62a439fddec tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:23.184794 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b8b26b48-b2e6-47b2-a5b1-e62a439fddec tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:23.185905 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b8b26b48-b2e6-47b2-a5b1-e62a439fddec tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:23.186366 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b8b26b48-b2e6-47b2-a5b1-e62a439fddec tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:23.250168 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9d0bec97-3f16-4e3b-8bca-121e62c5ba5c tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 204 len: 0 microversion: 2.1 time: 0.117695 Dec 15 13:09:23.250800 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 552/1044] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Dec 15 13:09:23 2021] DELETE /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:09:23.253602 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-b8b26b48-b2e6-47b2-a5b1-e62a439fddec tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 14 microversion: 2.20 time: 0.083584 Dec 15 13:09:23.255112 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 493/1045] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:23 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:09:23.259823 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-680b8a63-ebcc-4272-8115-4a3a22df45ea tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:23.260601 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-680b8a63-ebcc-4272-8115-4a3a22df45ea tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:23.266773 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-680b8a63-ebcc-4272-8115-4a3a22df45ea tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:23.267205 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-680b8a63-ebcc-4272-8115-4a3a22df45ea tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:23.267974 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-680b8a63-ebcc-4272-8115-4a3a22df45ea tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:23.268400 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-680b8a63-ebcc-4272-8115-4a3a22df45ea tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:23.412744 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-680b8a63-ebcc-4272-8115-4a3a22df45ea tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:23.422734 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-680b8a63-ebcc-4272-8115-4a3a22df45ea tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1552 microversion: 2.1 time: 0.166660 Dec 15 13:09:23.431658 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 553/1046] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:23 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1552 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:23.618081 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-897f8f77-88eb-4841-b601-8697663374b7 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:23.618808 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-897f8f77-88eb-4841-b601-8697663374b7 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:23.625512 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-897f8f77-88eb-4841-b601-8697663374b7 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:23.625956 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-897f8f77-88eb-4841-b601-8697663374b7 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:23.626842 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-897f8f77-88eb-4841-b601-8697663374b7 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:23.627274 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-897f8f77-88eb-4841-b601-8697663374b7 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:23.641355 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.wsgi [None req-897f8f77-88eb-4841-b601-8697663374b7 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] HTTP exception thrown: Instance 8d29665f-f416-4d8b-8a0a-7e1eb1515440 could not be found. Dec 15 13:09:23.641935 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-897f8f77-88eb-4841-b601-8697663374b7 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Returning 404 to user: Instance 8d29665f-f416-4d8b-8a0a-7e1eb1515440 could not be found. {{(pid=116097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:09:23.642776 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-897f8f77-88eb-4841-b601-8697663374b7 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 404 len: 111 microversion: 2.1 time: 0.028681 Dec 15 13:09:23.643299 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 494/1047] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:23 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:09:23.651937 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-72a64443-323e-43cc-b1f3-6714bea6b530 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '.version_select at 0x7faf1808baf0>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:23.690771 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-72a64443-323e-43cc-b1f3-6714bea6b530 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1853052979" status: 202 len: 0 microversion: 2.1 time: 0.042894 Dec 15 13:09:23.691342 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 554/1048] 10.222.0.57 () {58 vars in 1220 bytes} [Wed Dec 15 13:09:23 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1853052979 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:09:23.694083 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-4e3da92d-acb6-43d6-9175-389ad93f366f tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] Calling method '.version_select at 0x7faf18103e50>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:23.721715 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.wsgi [None req-4e3da92d-acb6-43d6-9175-389ad93f366f tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] HTTP exception thrown: Volume 84f4a6f0-418e-4b5c-badf-f92ef2eb8599 could not be found. Dec 15 13:09:23.722349 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-4e3da92d-acb6-43d6-9175-389ad93f366f tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] Returning 404 to user: Volume 84f4a6f0-418e-4b5c-badf-f92ef2eb8599 could not be found. {{(pid=116097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:09:23.723165 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-4e3da92d-acb6-43d6-9175-389ad93f366f tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/84f4a6f0-418e-4b5c-badf-f92ef2eb8599" status: 404 len: 109 microversion: 2.1 time: 0.034000 Dec 15 13:09:23.723828 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 495/1049] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Dec 15 13:09:23 2021] GET /compute/v2.1/os-volumes/84f4a6f0-418e-4b5c-badf-f92ef2eb8599 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 13:09:23.733198 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e80be498-97cd-4e20-88fc-71771a71faf8 tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] Calling method '.version_select at 0x7faf182d6160>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:23.762488 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-e80be498-97cd-4e20-88fc-71771a71faf8 tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] HTTP exception thrown: Volume 84f4a6f0-418e-4b5c-badf-f92ef2eb8599 could not be found. Dec 15 13:09:23.763077 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e80be498-97cd-4e20-88fc-71771a71faf8 tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] Returning 404 to user: Volume 84f4a6f0-418e-4b5c-badf-f92ef2eb8599 could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:09:23.763892 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e80be498-97cd-4e20-88fc-71771a71faf8 tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/84f4a6f0-418e-4b5c-badf-f92ef2eb8599" status: 404 len: 109 microversion: 2.1 time: 0.034345 Dec 15 13:09:23.766275 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 555/1050] 10.222.0.57 () {58 vars in 1247 bytes} [Wed Dec 15 13:09:23 2021] DELETE /compute/v2.1/os-volumes/84f4a6f0-418e-4b5c-badf-f92ef2eb8599 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:09:23.773565 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-282809ed-2559-4435-905f-365222b8ae83 tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] Calling method '.version_select at 0x7faf12fe9160>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:23.799521 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.wsgi [None req-282809ed-2559-4435-905f-365222b8ae83 tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] HTTP exception thrown: Volume 84f4a6f0-418e-4b5c-badf-f92ef2eb8599 could not be found. Dec 15 13:09:23.800118 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-282809ed-2559-4435-905f-365222b8ae83 tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] Returning 404 to user: Volume 84f4a6f0-418e-4b5c-badf-f92ef2eb8599 could not be found. {{(pid=116097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:09:23.801077 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-282809ed-2559-4435-905f-365222b8ae83 tempest-VolumesSnapshotsTestJSON-1196103253 tempest-VolumesSnapshotsTestJSON-1196103253-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/84f4a6f0-418e-4b5c-badf-f92ef2eb8599" status: 404 len: 109 microversion: 2.1 time: 0.032727 Dec 15 13:09:23.801634 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 496/1051] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Dec 15 13:09:23 2021] GET /compute/v2.1/os-volumes/84f4a6f0-418e-4b5c-badf-f92ef2eb8599 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:09:24.266744 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-42cb8586-bbfa-4d95-b156-01c3895aa504 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:24.267628 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-42cb8586-bbfa-4d95-b156-01c3895aa504 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:24.277270 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-42cb8586-bbfa-4d95-b156-01c3895aa504 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:24.277719 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-42cb8586-bbfa-4d95-b156-01c3895aa504 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:24.279757 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-42cb8586-bbfa-4d95-b156-01c3895aa504 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:24.280198 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-42cb8586-bbfa-4d95-b156-01c3895aa504 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:24.346294 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-42cb8586-bbfa-4d95-b156-01c3895aa504 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 14 microversion: 2.20 time: 0.083735 Dec 15 13:09:24.349824 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 556/1052] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:24 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:24.365506 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-1cdc7a76-314e-4152-800d-fa31c3256c52 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'create', calling method: .version_select at 0x7faf12f83b80>, body: {"keypair": {"name": "tempest-keypair-503347203"}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:24.380179 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-1cdc7a76-314e-4152-800d-fa31c3256c52 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Getting quotas for project 9d0255d615a14a41af48a7a999a42469. Resources: {'key_pairs'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:09:24.383994 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-1cdc7a76-314e-4152-800d-fa31c3256c52 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Getting quotas for user ff7f1cc9a2214907871542822081375f and project 9d0255d615a14a41af48a7a999a42469. Resources: {'key_pairs'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:09:24.440857 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-418760a8-5cdc-45aa-8593-9f8e46bda8cf tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:24.441688 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-418760a8-5cdc-45aa-8593-9f8e46bda8cf tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:24.448875 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-418760a8-5cdc-45aa-8593-9f8e46bda8cf tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:24.449730 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-418760a8-5cdc-45aa-8593-9f8e46bda8cf tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:24.450701 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-418760a8-5cdc-45aa-8593-9f8e46bda8cf tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:24.451421 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-418760a8-5cdc-45aa-8593-9f8e46bda8cf tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:24.566494 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-1cdc7a76-314e-4152-800d-fa31c3256c52 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Getting quotas for project 9d0255d615a14a41af48a7a999a42469. Resources: {'key_pairs'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:09:24.570176 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-1cdc7a76-314e-4152-800d-fa31c3256c52 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Getting quotas for user ff7f1cc9a2214907871542822081375f and project 9d0255d615a14a41af48a7a999a42469. Resources: {'key_pairs'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:09:24.583073 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-1cdc7a76-314e-4152-800d-fa31c3256c52 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 2296 microversion: 2.1 time: 0.221945 Dec 15 13:09:24.589475 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 497/1053] 10.222.0.57 () {60 vars in 1157 bytes} [Wed Dec 15 13:09:24 2021] POST /compute/v2.1/os-keypairs => generated 2296 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:24.648784 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-418760a8-5cdc-45aa-8593-9f8e46bda8cf tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:24.661673 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-418760a8-5cdc-45aa-8593-9f8e46bda8cf tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1552 microversion: 2.1 time: 0.224541 Dec 15 13:09:24.663017 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 557/1054] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:24 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1552 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:09:25.357418 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-bb16eac6-b1d0-482e-9a70-2f98fad2cb7a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:25.358470 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-bb16eac6-b1d0-482e-9a70-2f98fad2cb7a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:25.369589 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-bb16eac6-b1d0-482e-9a70-2f98fad2cb7a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:25.370214 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-bb16eac6-b1d0-482e-9a70-2f98fad2cb7a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:25.372259 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-bb16eac6-b1d0-482e-9a70-2f98fad2cb7a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:25.373052 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-bb16eac6-b1d0-482e-9a70-2f98fad2cb7a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:25.443974 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-bb16eac6-b1d0-482e-9a70-2f98fad2cb7a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 14 microversion: 2.20 time: 0.090382 Dec 15 13:09:25.448998 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 498/1055] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:25 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:25.679634 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-bf0a0ff5-0552-4c24-891e-bfa401cede2a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:25.680247 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-bf0a0ff5-0552-4c24-891e-bfa401cede2a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:25.703603 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bf0a0ff5-0552-4c24-891e-bfa401cede2a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:25.714553 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-9fb64977-ea17-4ba0-bafc-65ba7635e342 req-67b885a6-cd9c-4e66-b1de-7d819147a6fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b62c709-a647-468b-bb79-1e1e20832c1e", "name": "network-vif-deleted", "tag": "235d69ca-304f-4a79-a570-8c3fd9220dcf"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:25.716884 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:09:25.716884 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:09:25.717812 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bf0a0ff5-0552-4c24-891e-bfa401cede2a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:25.718961 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bf0a0ff5-0552-4c24-891e-bfa401cede2a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:25.719442 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bf0a0ff5-0552-4c24-891e-bfa401cede2a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:25.751235 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-9fb64977-ea17-4ba0-bafc-65ba7635e342 req-67b885a6-cd9c-4e66-b1de-7d819147a6fd service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:25.753249 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-9fb64977-ea17-4ba0-bafc-65ba7635e342 req-67b885a6-cd9c-4e66-b1de-7d819147a6fd service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:25.768784 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-9fb64977-ea17-4ba0-bafc-65ba7635e342 req-67b885a6-cd9c-4e66-b1de-7d819147a6fd service nova] Creating event network-vif-deleted:235d69ca-304f-4a79-a570-8c3fd9220dcf for instance 5b62c709-a647-468b-bb79-1e1e20832c1e on hv-cinder-81322 Dec 15 13:09:25.774214 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-9fb64977-ea17-4ba0-bafc-65ba7635e342 req-67b885a6-cd9c-4e66-b1de-7d819147a6fd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066226 Dec 15 13:09:25.775546 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 499/1056] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:09:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:09:25.831625 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-bf0a0ff5-0552-4c24-891e-bfa401cede2a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc76cb4eb2843c9af7299c422400125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:25.844205 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-bf0a0ff5-0552-4c24-891e-bfa401cede2a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 200 len: 1510 microversion: 2.1 time: 0.168405 Dec 15 13:09:25.844777 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 558/1057] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:25 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:26.404932 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-9b0f3c05-f984-4b78-8d2c-8517b906f43f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-465984349", "imageRef": "67890983-693f-44ed-bdf3-22321abeab26", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "215eb43b-ffe8-4825-a527-195837dc5851"}], "security_groups": [{"name": "tempest-securitygroup--2009415681"}], "key_name": "tempest-keypair-503347203", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:26.455758 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-2b4c59e9-b208-4793-b5ac-542ccbf3506e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:26.456684 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-2b4c59e9-b208-4793-b5ac-542ccbf3506e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:26.464590 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2b4c59e9-b208-4793-b5ac-542ccbf3506e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:26.465075 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2b4c59e9-b208-4793-b5ac-542ccbf3506e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:26.465867 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2b4c59e9-b208-4793-b5ac-542ccbf3506e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:26.466337 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2b4c59e9-b208-4793-b5ac-542ccbf3506e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:26.516499 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.network.neutron [None req-9b0f3c05-f984-4b78-8d2c-8517b906f43f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] validate_networks() for [('215eb43b-ffe8-4825-a527-195837dc5851', None, None, None, None, None)] {{(pid=116097) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:09:26.538923 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-2b4c59e9-b208-4793-b5ac-542ccbf3506e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 11454 microversion: 2.20 time: 0.086874 Dec 15 13:09:26.539844 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 559/1058] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:26 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 11454 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:09:26.843282 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-fd0f697d-3613-4752-bf13-035c1c196b0f tempest-VolumesTestJSON-1270918634 tempest-VolumesTestJSON-1270918634-project] Calling method '.version_select at 0x7faf180d7ee0>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:26.896089 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-fd0f697d-3613-4752-bf13-035c1c196b0f tempest-VolumesTestJSON-1270918634 tempest-VolumesTestJSON-1270918634-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/cc2e93c2-a2c2-481e-81c5-8189139ac7c4" status: 200 len: 351 microversion: 2.1 time: 0.055232 Dec 15 13:09:26.896089 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 560/1059] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Dec 15 13:09:26 2021] GET /compute/v2.1/os-volumes/cc2e93c2-a2c2-481e-81c5-8189139ac7c4 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:09:26.900727 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a4ee2360-dba3-4de9-8539-590fe461a80a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:26.901636 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a4ee2360-dba3-4de9-8539-590fe461a80a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] [instance: 5b62c709-a647-468b-bb79-1e1e20832c1e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:26.912032 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a4ee2360-dba3-4de9-8539-590fe461a80a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:26.912701 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a4ee2360-dba3-4de9-8539-590fe461a80a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:26.913638 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a4ee2360-dba3-4de9-8539-590fe461a80a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:26.914447 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a4ee2360-dba3-4de9-8539-590fe461a80a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:26.929896 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-a4ee2360-dba3-4de9-8539-590fe461a80a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] HTTP exception thrown: Instance 5b62c709-a647-468b-bb79-1e1e20832c1e could not be found. Dec 15 13:09:26.930535 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a4ee2360-dba3-4de9-8539-590fe461a80a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Returning 404 to user: Instance 5b62c709-a647-468b-bb79-1e1e20832c1e could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:09:26.931842 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a4ee2360-dba3-4de9-8539-590fe461a80a tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e" status: 404 len: 111 microversion: 2.1 time: 0.035227 Dec 15 13:09:26.932386 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 561/1060] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:26 2021] GET /compute/v2.1/servers/5b62c709-a647-468b-bb79-1e1e20832c1e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:09:26.940758 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f4c91be5-4c10-40e4-94e2-2f92091f1b87 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] Calling method '.version_select at 0x7faf18156b80>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:26.961429 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f4c91be5-4c10-40e4-94e2-2f92091f1b87 tempest-TestMinimumBasicScenario-687039359 tempest-TestMinimumBasicScenario-687039359-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-98634662" status: 202 len: 0 microversion: 2.1 time: 0.024182 Dec 15 13:09:26.962355 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 562/1061] 10.222.0.57 () {58 vars in 1265 bytes} [Wed Dec 15 13:09:26 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-98634662 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:09:27.105961 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-9b0f3c05-f984-4b78-8d2c-8517b906f43f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Flavor limits 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:09:27.105961 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-9b0f3c05-f984-4b78-8d2c-8517b906f43f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Image limits 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:09:27.105961 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-9b0f3c05-f984-4b78-8d2c-8517b906f43f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Flavor pref 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:09:27.105961 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-9b0f3c05-f984-4b78-8d2c-8517b906f43f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Image pref 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:09:27.105961 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-9b0f3c05-f984-4b78-8d2c-8517b906f43f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:09:27.118521 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9b0f3c05-f984-4b78-8d2c-8517b906f43f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:27.119508 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9b0f3c05-f984-4b78-8d2c-8517b906f43f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:27.120343 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9b0f3c05-f984-4b78-8d2c-8517b906f43f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:27.120782 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9b0f3c05-f984-4b78-8d2c-8517b906f43f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:27.173549 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-9b0f3c05-f984-4b78-8d2c-8517b906f43f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Getting quotas for project 9d0255d615a14a41af48a7a999a42469. Resources: {'instances', 'cores', 'ram'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:09:27.178801 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-9b0f3c05-f984-4b78-8d2c-8517b906f43f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Getting quotas for user ff7f1cc9a2214907871542822081375f and project 9d0255d615a14a41af48a7a999a42469. Resources: {'instances', 'cores', 'ram'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:09:27.193748 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-9b0f3c05-f984-4b78-8d2c-8517b906f43f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Going to run 1 instances... {{(pid=116097) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:09:27.196509 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-9b0f3c05-f984-4b78-8d2c-8517b906f43f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67890983-693f-44ed-bdf3-22321abeab26',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:09:27.246986 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-9b0f3c05-f984-4b78-8d2c-8517b906f43f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.846811 Dec 15 13:09:27.247819 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 500/1062] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Dec 15 13:09:26 2021] POST /compute/v2.1/servers => generated 402 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 13:09:27.258489 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-01371b14-b6a0-4a41-a383-ec9337ceeeb4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:27.260016 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-01371b14-b6a0-4a41-a383-ec9337ceeeb4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:27.345054 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-01371b14-b6a0-4a41-a383-ec9337ceeeb4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:27.372416 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-01371b14-b6a0-4a41-a383-ec9337ceeeb4 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1" status: 200 len: 1236 microversion: 2.1 time: 0.118374 Dec 15 13:09:27.374527 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 563/1063] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:27 2021] GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1 => generated 1236 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:27.551000 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-a12e65ee-83d4-45ad-8950-c45e47ebe653 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:27.551922 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-a12e65ee-83d4-45ad-8950-c45e47ebe653 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:27.569671 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a12e65ee-83d4-45ad-8950-c45e47ebe653 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:27.570136 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a12e65ee-83d4-45ad-8950-c45e47ebe653 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:27.571036 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a12e65ee-83d4-45ad-8950-c45e47ebe653 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:27.571570 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a12e65ee-83d4-45ad-8950-c45e47ebe653 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:27.651991 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-a12e65ee-83d4-45ad-8950-c45e47ebe653 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 18498 microversion: 2.20 time: 0.104974 Dec 15 13:09:27.652627 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 501/1064] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:27 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 18498 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:09:28.308009 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5c801a6b-c342-402e-82a6-40a35349cd11 tempest-VolumesTestJSON-1270918634 tempest-VolumesTestJSON-1270918634-project] Calling method '.version_select at 0x7faf180349d0>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:28.389978 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5c801a6b-c342-402e-82a6-40a35349cd11 tempest-VolumesTestJSON-1270918634 tempest-VolumesTestJSON-1270918634-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/09283c9d-1d2d-40da-8bb5-60436153b7a8" status: 200 len: 351 microversion: 2.1 time: 0.087129 Dec 15 13:09:28.390718 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 564/1065] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Dec 15 13:09:28 2021] GET /compute/v2.1/os-volumes/09283c9d-1d2d-40da-8bb5-60436153b7a8 => generated 351 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:09:28.402760 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-14b60221-3c05-4d6c-bc59-dd467b2c69c6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:28.402760 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-14b60221-3c05-4d6c-bc59-dd467b2c69c6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:28.409184 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-14b60221-3c05-4d6c-bc59-dd467b2c69c6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:28.412958 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-14b60221-3c05-4d6c-bc59-dd467b2c69c6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:28.414858 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-14b60221-3c05-4d6c-bc59-dd467b2c69c6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:28.415315 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-14b60221-3c05-4d6c-bc59-dd467b2c69c6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:28.529298 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-14b60221-3c05-4d6c-bc59-dd467b2c69c6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:28.542585 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-14b60221-3c05-4d6c-bc59-dd467b2c69c6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1" status: 200 len: 1296 microversion: 2.1 time: 0.154626 Dec 15 13:09:28.543134 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 502/1066] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:28 2021] GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1 => generated 1296 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:28.665018 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ac1e0a30-09ad-47b7-b674-757bad90b28d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:28.666033 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ac1e0a30-09ad-47b7-b674-757bad90b28d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:28.676186 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ac1e0a30-09ad-47b7-b674-757bad90b28d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:28.676548 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ac1e0a30-09ad-47b7-b674-757bad90b28d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:28.683235 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ac1e0a30-09ad-47b7-b674-757bad90b28d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:28.683857 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ac1e0a30-09ad-47b7-b674-757bad90b28d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:28.797386 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ac1e0a30-09ad-47b7-b674-757bad90b28d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 19226 microversion: 2.20 time: 0.137821 Dec 15 13:09:28.802814 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 565/1067] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:28 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 19226 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:09:29.563430 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-87b2cb51-2c13-4e2d-a329-96e433a646b3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:29.564636 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-87b2cb51-2c13-4e2d-a329-96e433a646b3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:29.572414 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-87b2cb51-2c13-4e2d-a329-96e433a646b3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:29.572864 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-87b2cb51-2c13-4e2d-a329-96e433a646b3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:29.573651 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-87b2cb51-2c13-4e2d-a329-96e433a646b3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:29.574084 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-87b2cb51-2c13-4e2d-a329-96e433a646b3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:29.823778 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-933540f0-dde8-419a-99ba-94a9698c204c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:29.825345 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-933540f0-dde8-419a-99ba-94a9698c204c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:29.833622 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-933540f0-dde8-419a-99ba-94a9698c204c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:29.834366 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-933540f0-dde8-419a-99ba-94a9698c204c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:29.835310 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-933540f0-dde8-419a-99ba-94a9698c204c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:29.835899 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-933540f0-dde8-419a-99ba-94a9698c204c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:29.917696 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-933540f0-dde8-419a-99ba-94a9698c204c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 21790 microversion: 2.20 time: 0.107729 Dec 15 13:09:29.918747 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 566/1068] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:29 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 21790 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:09:30.021305 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6cc34121-d9b6-4e87-9a98-0ffd044cec75 tempest-VolumesTestJSON-1270918634 tempest-VolumesTestJSON-1270918634-project] Calling method '.version_select at 0x7faf18034af0>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:30.052275 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-87b2cb51-2c13-4e2d-a329-96e433a646b3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:30.064640 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-87b2cb51-2c13-4e2d-a329-96e433a646b3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1" status: 200 len: 1362 microversion: 2.1 time: 0.506182 Dec 15 13:09:30.067945 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 503/1069] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:29 2021] GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1 => generated 1362 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:30.092744 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6cc34121-d9b6-4e87-9a98-0ffd044cec75 tempest-VolumesTestJSON-1270918634 tempest-VolumesTestJSON-1270918634-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/0cbdec69-bef0-4c9d-94bd-6a6ef7b3f138" status: 200 len: 351 microversion: 2.1 time: 0.076378 Dec 15 13:09:30.100896 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 567/1070] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Dec 15 13:09:30 2021] GET /compute/v2.1/os-volumes/0cbdec69-bef0-4c9d-94bd-6a6ef7b3f138 => generated 351 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:09:30.105448 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-c5a5d003-f4d2-445f-ac5e-15a7a08709ba tempest-VolumesTestJSON-1270918634 tempest-VolumesTestJSON-1270918634-project] Calling method '.version_select at 0x7faf12fb6f70>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:30.424670 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-c5a5d003-f4d2-445f-ac5e-15a7a08709ba tempest-VolumesTestJSON-1270918634 tempest-VolumesTestJSON-1270918634-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.324012 Dec 15 13:09:30.425699 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 504/1071] 10.222.0.57 () {58 vars in 1133 bytes} [Wed Dec 15 13:09:30 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:09:30.448405 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-86ca66b3-173b-47c7-9b7c-d6c1262280e6 tempest-VolumesTestJSON-1270918634 tempest-VolumesTestJSON-1270918634-project] Calling method '.version_select at 0x7faf1809eee0>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:30.628684 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-0df17600-0a25-4d07-9160-06f30315b35e req-f02b39d0-1e5d-46dd-b924-c1d53093605d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28db6998-c25f-4217-82a4-27a03db8dff1", "tag": "4d6169ab-848d-4edd-8099-1fe5303738ce"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:30.631595 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:09:30.631595 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:09:30.658681 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-0df17600-0a25-4d07-9160-06f30315b35e req-f02b39d0-1e5d-46dd-b924-c1d53093605d service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:30.659123 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-0df17600-0a25-4d07-9160-06f30315b35e req-f02b39d0-1e5d-46dd-b924-c1d53093605d service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:30.680210 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-0df17600-0a25-4d07-9160-06f30315b35e req-f02b39d0-1e5d-46dd-b924-c1d53093605d service nova] Creating event network-changed:4d6169ab-848d-4edd-8099-1fe5303738ce for instance 28db6998-c25f-4217-82a4-27a03db8dff1 on hv-cinder-81322 Dec 15 13:09:30.687607 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-0df17600-0a25-4d07-9160-06f30315b35e req-f02b39d0-1e5d-46dd-b924-c1d53093605d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069944 Dec 15 13:09:30.700742 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 505/1072] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:09:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:09:30.705442 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-86ca66b3-173b-47c7-9b7c-d6c1262280e6 tempest-VolumesTestJSON-1270918634 tempest-VolumesTestJSON-1270918634-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.269840 Dec 15 13:09:30.706076 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 568/1073] 10.222.0.57 () {58 vars in 1148 bytes} [Wed Dec 15 13:09:30 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:09:30.722644 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-62897bdc-163f-4a87-9a22-6423e9000974 tempest-VolumesTestJSON-1270918634 tempest-VolumesTestJSON-1270918634-project] Calling method '.version_select at 0x7faf1c00dca0>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:30.905895 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-62897bdc-163f-4a87-9a22-6423e9000974 tempest-VolumesTestJSON-1270918634 tempest-VolumesTestJSON-1270918634-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.189914 Dec 15 13:09:30.906631 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 506/1074] 10.222.0.57 () {58 vars in 1133 bytes} [Wed Dec 15 13:09:30 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:30.922867 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6185f3f7-73f9-4bc5-ba7e-a6878897a484 tempest-VolumesTestJSON-1270918634 tempest-VolumesTestJSON-1270918634-project] Calling method '.version_select at 0x7faf18156040>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:30.935815 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-037f9e62-bedb-48d6-b6d0-2e1b190a6f28 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:30.937842 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-037f9e62-bedb-48d6-b6d0-2e1b190a6f28 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:30.960040 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-037f9e62-bedb-48d6-b6d0-2e1b190a6f28 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:30.960689 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-037f9e62-bedb-48d6-b6d0-2e1b190a6f28 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:30.961862 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-037f9e62-bedb-48d6-b6d0-2e1b190a6f28 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:30.963012 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-037f9e62-bedb-48d6-b6d0-2e1b190a6f28 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:31.063636 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6185f3f7-73f9-4bc5-ba7e-a6878897a484 tempest-VolumesTestJSON-1270918634 tempest-VolumesTestJSON-1270918634-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.145527 Dec 15 13:09:31.064655 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 569/1075] 10.222.0.57 () {58 vars in 1166 bytes} [Wed Dec 15 13:09:30 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:09:31.075018 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-037f9e62-bedb-48d6-b6d0-2e1b190a6f28 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 23235 microversion: 2.20 time: 0.137970 Dec 15 13:09:31.075018 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 507/1076] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:30 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 23235 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:09:31.080568 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-f74fd898-08a6-4918-b57d-7627358be21f tempest-VolumesTestJSON-1270918634 tempest-VolumesTestJSON-1270918634-project] Calling method '.version_select at 0x7faf180904c0>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:31.095296 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7519bb70-8e8a-4084-86fa-ee5461c00069 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:31.096440 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7519bb70-8e8a-4084-86fa-ee5461c00069 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:31.111209 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7519bb70-8e8a-4084-86fa-ee5461c00069 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:31.113146 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7519bb70-8e8a-4084-86fa-ee5461c00069 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:31.114621 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7519bb70-8e8a-4084-86fa-ee5461c00069 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:31.115389 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7519bb70-8e8a-4084-86fa-ee5461c00069 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:31.171204 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-f74fd898-08a6-4918-b57d-7627358be21f tempest-VolumesTestJSON-1270918634 tempest-VolumesTestJSON-1270918634-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.094690 Dec 15 13:09:31.182194 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 508/1077] 10.222.0.57 () {58 vars in 1169 bytes} [Wed Dec 15 13:09:31 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:09:31.191047 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-cd4c8897-6645-4c66-8e00-dd9066027a3f tempest-VolumesTestJSON-1270918634 tempest-VolumesTestJSON-1270918634-project] Calling method '.version_select at 0x7faf1c00d0d0>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:31.483632 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-7519bb70-8e8a-4084-86fa-ee5461c00069 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:31.507029 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7519bb70-8e8a-4084-86fa-ee5461c00069 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1" status: 200 len: 1362 microversion: 2.1 time: 0.415741 Dec 15 13:09:31.508180 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-cd4c8897-6645-4c66-8e00-dd9066027a3f tempest-VolumesTestJSON-1270918634 tempest-VolumesTestJSON-1270918634-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.321797 Dec 15 13:09:31.509188 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 509/1079] 10.222.0.57 () {58 vars in 1154 bytes} [Wed Dec 15 13:09:31 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:31.519737 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 570/1079] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:31 2021] GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1 => generated 1362 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:31.526541 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-6eababf7-c045-4d2a-beb6-99bdf4a42867 tempest-VolumesTestJSON-1270918634 tempest-VolumesTestJSON-1270918634-project] Calling method '.version_select at 0x7faf1c037b80>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:31.614801 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-6eababf7-c045-4d2a-beb6-99bdf4a42867 tempest-VolumesTestJSON-1270918634 tempest-VolumesTestJSON-1270918634-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.093934 Dec 15 13:09:31.615361 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 510/1080] 10.222.0.57 () {58 vars in 1187 bytes} [Wed Dec 15 13:09:31 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:09:31.631008 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-294744f4-f166-4769-bd80-916a71ecbb62 tempest-VolumesTestJSON-1270918634 tempest-VolumesTestJSON-1270918634-project] Calling method '.version_select at 0x7faf18051ca0>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:31.794463 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-294744f4-f166-4769-bd80-916a71ecbb62 tempest-VolumesTestJSON-1270918634 tempest-VolumesTestJSON-1270918634-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.169948 Dec 15 13:09:31.795551 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 571/1081] 10.222.0.57 () {58 vars in 1154 bytes} [Wed Dec 15 13:09:31 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:32.088461 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-0faf3d0a-c2b1-4538-818b-0be974d7d387 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:32.089501 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-0faf3d0a-c2b1-4538-818b-0be974d7d387 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:32.104690 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0faf3d0a-c2b1-4538-818b-0be974d7d387 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:32.107125 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0faf3d0a-c2b1-4538-818b-0be974d7d387 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:32.109820 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0faf3d0a-c2b1-4538-818b-0be974d7d387 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:32.111541 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0faf3d0a-c2b1-4538-818b-0be974d7d387 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:32.236280 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-0faf3d0a-c2b1-4538-818b-0be974d7d387 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 24746 microversion: 2.20 time: 0.151469 Dec 15 13:09:32.238616 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 511/1082] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:32 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 24746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:09:32.531015 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-90d36a28-a024-45d5-a456-d8fd149ca256 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:32.532259 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-90d36a28-a024-45d5-a456-d8fd149ca256 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:32.538788 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-90d36a28-a024-45d5-a456-d8fd149ca256 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:32.539491 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-90d36a28-a024-45d5-a456-d8fd149ca256 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:32.540987 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-90d36a28-a024-45d5-a456-d8fd149ca256 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:32.541415 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-90d36a28-a024-45d5-a456-d8fd149ca256 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:32.688905 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-90d36a28-a024-45d5-a456-d8fd149ca256 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:32.711881 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-90d36a28-a024-45d5-a456-d8fd149ca256 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1" status: 200 len: 1362 microversion: 2.1 time: 0.185853 Dec 15 13:09:32.712623 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 572/1083] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:32 2021] GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1 => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:33.248287 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-ee07278c-8e70-4883-8fba-6c1823156fb2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:33.249287 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-ee07278c-8e70-4883-8fba-6c1823156fb2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:33.255999 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ee07278c-8e70-4883-8fba-6c1823156fb2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:33.256451 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ee07278c-8e70-4883-8fba-6c1823156fb2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:33.257233 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ee07278c-8e70-4883-8fba-6c1823156fb2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:33.257723 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ee07278c-8e70-4883-8fba-6c1823156fb2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:33.328918 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-ee07278c-8e70-4883-8fba-6c1823156fb2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 26329 microversion: 2.20 time: 0.084380 Dec 15 13:09:33.330328 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 512/1084] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:33 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 26329 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:09:33.729577 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-593f8115-e399-460d-80c7-ff377410829a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:33.730428 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-593f8115-e399-460d-80c7-ff377410829a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:33.737148 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-593f8115-e399-460d-80c7-ff377410829a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:33.737599 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-593f8115-e399-460d-80c7-ff377410829a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:33.738409 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-593f8115-e399-460d-80c7-ff377410829a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:33.739087 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-593f8115-e399-460d-80c7-ff377410829a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:33.951252 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-593f8115-e399-460d-80c7-ff377410829a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:33.961718 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-593f8115-e399-460d-80c7-ff377410829a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1" status: 200 len: 1362 microversion: 2.1 time: 0.236535 Dec 15 13:09:33.963359 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 573/1085] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:33 2021] GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1 => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:34.342041 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-46795661-1224-4e4c-9e8f-42cb79254b10 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:34.343216 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-46795661-1224-4e4c-9e8f-42cb79254b10 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:34.357313 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-46795661-1224-4e4c-9e8f-42cb79254b10 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:34.357884 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-46795661-1224-4e4c-9e8f-42cb79254b10 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:34.360932 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-46795661-1224-4e4c-9e8f-42cb79254b10 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:34.361471 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-46795661-1224-4e4c-9e8f-42cb79254b10 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:34.469291 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-46795661-1224-4e4c-9e8f-42cb79254b10 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 27479 microversion: 2.20 time: 0.131805 Dec 15 13:09:34.471206 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 513/1086] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:34 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 27479 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:09:34.979600 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-bab56984-ce60-40ed-a8fd-d4816d5c9952 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:34.980862 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-bab56984-ce60-40ed-a8fd-d4816d5c9952 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:34.991204 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bab56984-ce60-40ed-a8fd-d4816d5c9952 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:34.991910 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bab56984-ce60-40ed-a8fd-d4816d5c9952 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:34.992946 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bab56984-ce60-40ed-a8fd-d4816d5c9952 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:34.996119 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bab56984-ce60-40ed-a8fd-d4816d5c9952 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:35.196052 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-bab56984-ce60-40ed-a8fd-d4816d5c9952 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:35.204586 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-bab56984-ce60-40ed-a8fd-d4816d5c9952 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1" status: 200 len: 1362 microversion: 2.1 time: 0.229410 Dec 15 13:09:35.210052 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 574/1087] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:34 2021] GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1 => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:35.484332 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-a98f44b0-3325-4fde-ad72-555977ab3f63 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:35.486582 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-a98f44b0-3325-4fde-ad72-555977ab3f63 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:35.495382 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a98f44b0-3325-4fde-ad72-555977ab3f63 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:35.496456 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a98f44b0-3325-4fde-ad72-555977ab3f63 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:35.497319 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a98f44b0-3325-4fde-ad72-555977ab3f63 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:35.497944 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a98f44b0-3325-4fde-ad72-555977ab3f63 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:35.579854 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-a98f44b0-3325-4fde-ad72-555977ab3f63 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 27958 microversion: 2.20 time: 0.102040 Dec 15 13:09:35.581344 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 514/1088] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:35 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 27958 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:09:36.226782 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-11c07f8a-0985-4090-b966-f5e51fc5bc22 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:36.227384 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-11c07f8a-0985-4090-b966-f5e51fc5bc22 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:36.240878 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-11c07f8a-0985-4090-b966-f5e51fc5bc22 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:36.241331 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-11c07f8a-0985-4090-b966-f5e51fc5bc22 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:36.246407 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-11c07f8a-0985-4090-b966-f5e51fc5bc22 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:36.246849 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-11c07f8a-0985-4090-b966-f5e51fc5bc22 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:36.537549 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-11c07f8a-0985-4090-b966-f5e51fc5bc22 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:36.545989 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-11c07f8a-0985-4090-b966-f5e51fc5bc22 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1" status: 200 len: 1362 microversion: 2.1 time: 0.323771 Dec 15 13:09:36.550454 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 575/1089] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:36 2021] GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1 => generated 1362 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:36.592110 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-c2a66320-c3ee-41c3-bec4-5d71011d7a03 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:36.593095 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-c2a66320-c3ee-41c3-bec4-5d71011d7a03 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:36.606705 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c2a66320-c3ee-41c3-bec4-5d71011d7a03 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:36.607336 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c2a66320-c3ee-41c3-bec4-5d71011d7a03 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:36.608584 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c2a66320-c3ee-41c3-bec4-5d71011d7a03 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:36.609183 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c2a66320-c3ee-41c3-bec4-5d71011d7a03 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:36.726911 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-c2a66320-c3ee-41c3-bec4-5d71011d7a03 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 28251 microversion: 2.20 time: 0.138221 Dec 15 13:09:36.728045 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 515/1090] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:36 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 28251 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:09:37.189962 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-938fcfe9-f0ba-4e3e-a421-d38676c10fdd req-559287f0-0f8e-468f-967b-45cfb08bc574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28db6998-c25f-4217-82a4-27a03db8dff1", "name": "network-vif-plugged", "status": "completed", "tag": "4d6169ab-848d-4edd-8099-1fe5303738ce"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:37.192069 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:09:37.192069 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:09:37.202040 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-938fcfe9-f0ba-4e3e-a421-d38676c10fdd req-559287f0-0f8e-468f-967b-45cfb08bc574 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:37.202811 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-938fcfe9-f0ba-4e3e-a421-d38676c10fdd req-559287f0-0f8e-468f-967b-45cfb08bc574 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:37.216306 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-938fcfe9-f0ba-4e3e-a421-d38676c10fdd req-559287f0-0f8e-468f-967b-45cfb08bc574 service nova] Creating event network-vif-plugged:4d6169ab-848d-4edd-8099-1fe5303738ce for instance 28db6998-c25f-4217-82a4-27a03db8dff1 on hv-cinder-81322 Dec 15 13:09:37.222628 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-938fcfe9-f0ba-4e3e-a421-d38676c10fdd req-559287f0-0f8e-468f-967b-45cfb08bc574 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.261487 Dec 15 13:09:37.223491 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 576/1091] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:09:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:09:37.565546 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-be3659de-f2e7-4401-823e-3c645f4489cf tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:37.566290 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-be3659de-f2e7-4401-823e-3c645f4489cf tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:37.573350 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-be3659de-f2e7-4401-823e-3c645f4489cf tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:37.573802 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-be3659de-f2e7-4401-823e-3c645f4489cf tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:37.574613 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-be3659de-f2e7-4401-823e-3c645f4489cf tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:37.575231 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-be3659de-f2e7-4401-823e-3c645f4489cf tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:37.732573 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-be3659de-f2e7-4401-823e-3c645f4489cf tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:37.739567 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ee5c3d33-0f02-46f7-9905-cec61a2527d4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:37.740781 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ee5c3d33-0f02-46f7-9905-cec61a2527d4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:37.742232 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-be3659de-f2e7-4401-823e-3c645f4489cf tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1" status: 200 len: 1362 microversion: 2.1 time: 0.181011 Dec 15 13:09:37.754101 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 516/1092] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:37 2021] GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:37.755123 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ee5c3d33-0f02-46f7-9905-cec61a2527d4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:37.755572 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ee5c3d33-0f02-46f7-9905-cec61a2527d4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:37.756440 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ee5c3d33-0f02-46f7-9905-cec61a2527d4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:37.756818 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ee5c3d33-0f02-46f7-9905-cec61a2527d4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:37.838295 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ee5c3d33-0f02-46f7-9905-cec61a2527d4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 28266 microversion: 2.20 time: 0.103253 Dec 15 13:09:37.839333 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 577/1093] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:37 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 28266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:09:38.760935 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-d3ab34b2-f3e0-41c0-82ce-dc5f61c7c46e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:38.762647 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-d3ab34b2-f3e0-41c0-82ce-dc5f61c7c46e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:38.769230 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d3ab34b2-f3e0-41c0-82ce-dc5f61c7c46e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:38.769708 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d3ab34b2-f3e0-41c0-82ce-dc5f61c7c46e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:38.770532 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d3ab34b2-f3e0-41c0-82ce-dc5f61c7c46e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:38.770962 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d3ab34b2-f3e0-41c0-82ce-dc5f61c7c46e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:38.850778 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d7de935d-350f-434b-ba52-9c37d26ca423 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:38.851756 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d7de935d-350f-434b-ba52-9c37d26ca423 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:38.859339 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d7de935d-350f-434b-ba52-9c37d26ca423 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:38.859792 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d7de935d-350f-434b-ba52-9c37d26ca423 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:38.860576 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d7de935d-350f-434b-ba52-9c37d26ca423 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:38.861010 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d7de935d-350f-434b-ba52-9c37d26ca423 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:38.909542 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-d3ab34b2-f3e0-41c0-82ce-dc5f61c7c46e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:38.917541 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-d3ab34b2-f3e0-41c0-82ce-dc5f61c7c46e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1" status: 200 len: 1548 microversion: 2.1 time: 0.161415 Dec 15 13:09:38.918123 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 517/1094] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:38 2021] GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1 => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:38.933057 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-2ca492d9-8aad-4755-8bdf-b3c0dc6e5f65 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:38.933539 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-2ca492d9-8aad-4755-8bdf-b3c0dc6e5f65 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:38.940150 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2ca492d9-8aad-4755-8bdf-b3c0dc6e5f65 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:38.940607 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2ca492d9-8aad-4755-8bdf-b3c0dc6e5f65 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:38.941381 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2ca492d9-8aad-4755-8bdf-b3c0dc6e5f65 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:38.941813 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-2ca492d9-8aad-4755-8bdf-b3c0dc6e5f65 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:38.941920 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d7de935d-350f-434b-ba52-9c37d26ca423 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 28542 microversion: 2.20 time: 0.094891 Dec 15 13:09:38.942538 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 578/1095] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:38 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 28542 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:09:39.026213 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-2ca492d9-8aad-4755-8bdf-b3c0dc6e5f65 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096407 Dec 15 13:09:39.027000 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 518/1096] 10.222.0.57 () {58 vars in 1274 bytes} [Wed Dec 15 13:09:38 2021] GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:09:39.954138 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ec62ae5d-4600-4fb2-bca1-5cbb1da05fe7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:39.955196 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ec62ae5d-4600-4fb2-bca1-5cbb1da05fe7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:39.962846 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ec62ae5d-4600-4fb2-bca1-5cbb1da05fe7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:39.963690 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ec62ae5d-4600-4fb2-bca1-5cbb1da05fe7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:39.964690 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ec62ae5d-4600-4fb2-bca1-5cbb1da05fe7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:39.965118 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ec62ae5d-4600-4fb2-bca1-5cbb1da05fe7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:40.051625 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ec62ae5d-4600-4fb2-bca1-5cbb1da05fe7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 28710 microversion: 2.20 time: 0.101592 Dec 15 13:09:40.054131 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 579/1097] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:39 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 28710 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:09:40.399331 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-bda830af-d2eb-4c5b-b107-8789970746f6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:40.401643 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-bda830af-d2eb-4c5b-b107-8789970746f6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:40.409831 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-bda830af-d2eb-4c5b-b107-8789970746f6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:40.410580 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-bda830af-d2eb-4c5b-b107-8789970746f6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:40.411401 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-bda830af-d2eb-4c5b-b107-8789970746f6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:40.411868 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-bda830af-d2eb-4c5b-b107-8789970746f6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:40.477635 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-bda830af-d2eb-4c5b-b107-8789970746f6 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action" status: 200 len: 14 microversion: 2.1 time: 0.095261 Dec 15 13:09:40.478585 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 519/1098] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:09:40 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:09:40.642284 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-31d04d4f-a837-4120-9f90-17db18eb9789 req-31ff8772-827b-40ae-a1df-d1a18f9c8feb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28db6998-c25f-4217-82a4-27a03db8dff1", "tag": "4d6169ab-848d-4edd-8099-1fe5303738ce"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:40.644127 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:09:40.644127 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:09:40.655718 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-31d04d4f-a837-4120-9f90-17db18eb9789 req-31ff8772-827b-40ae-a1df-d1a18f9c8feb service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:40.656604 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-31d04d4f-a837-4120-9f90-17db18eb9789 req-31ff8772-827b-40ae-a1df-d1a18f9c8feb service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:40.671644 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-31d04d4f-a837-4120-9f90-17db18eb9789 req-31ff8772-827b-40ae-a1df-d1a18f9c8feb service nova] Creating event network-changed:4d6169ab-848d-4edd-8099-1fe5303738ce for instance 28db6998-c25f-4217-82a4-27a03db8dff1 on hv-cinder-81322 Dec 15 13:09:40.679332 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-31d04d4f-a837-4120-9f90-17db18eb9789 req-31ff8772-827b-40ae-a1df-d1a18f9c8feb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.289014 Dec 15 13:09:40.684416 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 580/1099] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:09:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:09:41.064314 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-75f22822-55b4-4ad4-8f4f-ac2559dbbb4c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:41.065477 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-75f22822-55b4-4ad4-8f4f-ac2559dbbb4c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:41.075290 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-75f22822-55b4-4ad4-8f4f-ac2559dbbb4c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:41.075994 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-75f22822-55b4-4ad4-8f4f-ac2559dbbb4c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:41.076898 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-75f22822-55b4-4ad4-8f4f-ac2559dbbb4c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:41.077459 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-75f22822-55b4-4ad4-8f4f-ac2559dbbb4c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:41.156410 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-75f22822-55b4-4ad4-8f4f-ac2559dbbb4c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 28710 microversion: 2.20 time: 0.096014 Dec 15 13:09:41.163413 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 520/1100] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:41 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 28710 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:09:41.489146 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-90166115-cf0b-4c8a-92b0-4e1663b9c34f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:41.490322 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-90166115-cf0b-4c8a-92b0-4e1663b9c34f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:41.500416 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-90166115-cf0b-4c8a-92b0-4e1663b9c34f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:41.500416 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-90166115-cf0b-4c8a-92b0-4e1663b9c34f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:41.500825 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-90166115-cf0b-4c8a-92b0-4e1663b9c34f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:41.503694 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-90166115-cf0b-4c8a-92b0-4e1663b9c34f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:41.568759 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-90166115-cf0b-4c8a-92b0-4e1663b9c34f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action" status: 200 len: 14 microversion: 2.1 time: 0.083322 Dec 15 13:09:41.569377 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 581/1101] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:09:41 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:09:42.171646 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-f63e95aa-b289-41bf-a464-cfa2af319c16 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:42.173255 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-f63e95aa-b289-41bf-a464-cfa2af319c16 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:42.180406 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f63e95aa-b289-41bf-a464-cfa2af319c16 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:42.181087 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f63e95aa-b289-41bf-a464-cfa2af319c16 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:42.182080 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f63e95aa-b289-41bf-a464-cfa2af319c16 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:42.182845 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f63e95aa-b289-41bf-a464-cfa2af319c16 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:42.249389 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-f63e95aa-b289-41bf-a464-cfa2af319c16 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 28710 microversion: 2.20 time: 0.081801 Dec 15 13:09:42.251255 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 521/1102] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:42 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 28710 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:09:42.580171 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-be7a3add-f4f1-468f-9ac2-1b87b86bb2de tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:42.581205 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-be7a3add-f4f1-468f-9ac2-1b87b86bb2de tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:42.589105 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be7a3add-f4f1-468f-9ac2-1b87b86bb2de tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:42.589561 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be7a3add-f4f1-468f-9ac2-1b87b86bb2de tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:42.590454 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be7a3add-f4f1-468f-9ac2-1b87b86bb2de tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:42.590826 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be7a3add-f4f1-468f-9ac2-1b87b86bb2de tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:42.660027 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-be7a3add-f4f1-468f-9ac2-1b87b86bb2de tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action" status: 200 len: 14 microversion: 2.1 time: 0.083755 Dec 15 13:09:42.660643 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 582/1103] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:09:42 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:09:43.261608 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-69c13256-28fe-48a6-a8c8-199ca2e4571c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:43.262820 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-69c13256-28fe-48a6-a8c8-199ca2e4571c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:43.269427 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-69c13256-28fe-48a6-a8c8-199ca2e4571c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:43.269872 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-69c13256-28fe-48a6-a8c8-199ca2e4571c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:43.270669 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-69c13256-28fe-48a6-a8c8-199ca2e4571c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:43.271109 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-69c13256-28fe-48a6-a8c8-199ca2e4571c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:43.349867 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-69c13256-28fe-48a6-a8c8-199ca2e4571c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 30237 microversion: 2.20 time: 0.092352 Dec 15 13:09:43.350542 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 522/1104] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:43 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 30237 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:09:43.672897 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7e4c9125-3036-4ca1-a302-3dacb04f2173 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:43.674112 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7e4c9125-3036-4ca1-a302-3dacb04f2173 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:43.682695 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7e4c9125-3036-4ca1-a302-3dacb04f2173 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:43.683726 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7e4c9125-3036-4ca1-a302-3dacb04f2173 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:43.684848 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7e4c9125-3036-4ca1-a302-3dacb04f2173 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:43.685544 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7e4c9125-3036-4ca1-a302-3dacb04f2173 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:43.905159 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7e4c9125-3036-4ca1-a302-3dacb04f2173 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action" status: 200 len: 14 microversion: 2.1 time: 0.237080 Dec 15 13:09:43.905953 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 583/1105] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:09:43 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action => generated 14 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:09:44.362675 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-6c1eafbe-23ea-4bd0-870e-5c2f674b43eb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:44.363675 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-6c1eafbe-23ea-4bd0-870e-5c2f674b43eb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:44.370860 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6c1eafbe-23ea-4bd0-870e-5c2f674b43eb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:44.371319 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6c1eafbe-23ea-4bd0-870e-5c2f674b43eb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:44.372094 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6c1eafbe-23ea-4bd0-870e-5c2f674b43eb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:44.372531 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6c1eafbe-23ea-4bd0-870e-5c2f674b43eb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:44.450244 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-6c1eafbe-23ea-4bd0-870e-5c2f674b43eb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 32212 microversion: 2.20 time: 0.091434 Dec 15 13:09:44.450859 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 523/1106] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:44 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 32212 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:09:44.917214 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-54e4a709-95f8-4b7f-a58e-2c02e72063e3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:44.918213 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-54e4a709-95f8-4b7f-a58e-2c02e72063e3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:44.924983 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-54e4a709-95f8-4b7f-a58e-2c02e72063e3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:44.925421 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-54e4a709-95f8-4b7f-a58e-2c02e72063e3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:44.926193 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-54e4a709-95f8-4b7f-a58e-2c02e72063e3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:44.926625 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-54e4a709-95f8-4b7f-a58e-2c02e72063e3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:44.986326 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-54e4a709-95f8-4b7f-a58e-2c02e72063e3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action" status: 200 len: 14 microversion: 2.1 time: 0.073569 Dec 15 13:09:44.986914 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 584/1107] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:09:44 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:09:45.474938 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-c62f4438-034d-4e1a-83e9-f9c61ba45672 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:45.476016 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-c62f4438-034d-4e1a-83e9-f9c61ba45672 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:45.484696 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c62f4438-034d-4e1a-83e9-f9c61ba45672 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:45.485608 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c62f4438-034d-4e1a-83e9-f9c61ba45672 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:45.486502 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c62f4438-034d-4e1a-83e9-f9c61ba45672 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:45.486945 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c62f4438-034d-4e1a-83e9-f9c61ba45672 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:45.564093 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-c62f4438-034d-4e1a-83e9-f9c61ba45672 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 33582 microversion: 2.20 time: 0.099654 Dec 15 13:09:45.564792 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 524/1108] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:45 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 33582 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:09:45.998334 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d6933ea9-648a-4374-b118-e97485966d92 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:45.999425 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d6933ea9-648a-4374-b118-e97485966d92 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:46.006400 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d6933ea9-648a-4374-b118-e97485966d92 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:46.006943 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d6933ea9-648a-4374-b118-e97485966d92 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:46.007800 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d6933ea9-648a-4374-b118-e97485966d92 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:46.008818 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d6933ea9-648a-4374-b118-e97485966d92 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:46.576173 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-1c0f131b-a96f-4c95-b79f-7ff740773cd4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:46.577090 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-1c0f131b-a96f-4c95-b79f-7ff740773cd4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:46.583754 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1c0f131b-a96f-4c95-b79f-7ff740773cd4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:46.584201 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1c0f131b-a96f-4c95-b79f-7ff740773cd4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:46.584972 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1c0f131b-a96f-4c95-b79f-7ff740773cd4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:46.585405 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1c0f131b-a96f-4c95-b79f-7ff740773cd4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:48.405739 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d6933ea9-648a-4374-b118-e97485966d92 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action" status: 200 len: 14 microversion: 2.1 time: 2.411488 Dec 15 13:09:48.406425 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 585/1109] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:09:45 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action => generated 14 bytes in 2413 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 13:09:48.431715 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-1c0f131b-a96f-4c95-b79f-7ff740773cd4 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 36353 microversion: 2.20 time: 1.859370 Dec 15 13:09:48.432785 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 525/1110] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:46 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 36353 bytes in 1861 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:09:49.418716 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6024f05f-b722-4c79-98f7-d5dca5a3027c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:49.419720 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-6024f05f-b722-4c79-98f7-d5dca5a3027c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:49.427504 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6024f05f-b722-4c79-98f7-d5dca5a3027c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:49.427980 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6024f05f-b722-4c79-98f7-d5dca5a3027c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:49.428843 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6024f05f-b722-4c79-98f7-d5dca5a3027c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:49.429266 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6024f05f-b722-4c79-98f7-d5dca5a3027c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:49.444550 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-3b93204f-aa7f-42d0-9b24-35a189463172 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:49.445547 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-3b93204f-aa7f-42d0-9b24-35a189463172 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:49.452908 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3b93204f-aa7f-42d0-9b24-35a189463172 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:49.453354 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3b93204f-aa7f-42d0-9b24-35a189463172 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:49.454208 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3b93204f-aa7f-42d0-9b24-35a189463172 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:49.454643 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3b93204f-aa7f-42d0-9b24-35a189463172 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:49.496320 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6024f05f-b722-4c79-98f7-d5dca5a3027c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action" status: 200 len: 14 microversion: 2.1 time: 0.082418 Dec 15 13:09:49.496930 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 586/1111] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:09:49 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:09:49.529056 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-3b93204f-aa7f-42d0-9b24-35a189463172 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 37416 microversion: 2.20 time: 0.088858 Dec 15 13:09:49.529674 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 526/1112] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:49 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 37416 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:09:50.512807 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5835a2b7-1466-4a21-a196-8ae965945758 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:50.512807 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5835a2b7-1466-4a21-a196-8ae965945758 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:50.517821 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5835a2b7-1466-4a21-a196-8ae965945758 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:50.518310 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5835a2b7-1466-4a21-a196-8ae965945758 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:50.519084 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5835a2b7-1466-4a21-a196-8ae965945758 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:50.519604 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5835a2b7-1466-4a21-a196-8ae965945758 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:50.541284 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-a78a7a58-67bd-4567-8392-a7ab761ae1e5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:50.542344 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-a78a7a58-67bd-4567-8392-a7ab761ae1e5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:50.549170 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a78a7a58-67bd-4567-8392-a7ab761ae1e5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:50.549620 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a78a7a58-67bd-4567-8392-a7ab761ae1e5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:50.550508 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a78a7a58-67bd-4567-8392-a7ab761ae1e5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:50.550951 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a78a7a58-67bd-4567-8392-a7ab761ae1e5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:50.582746 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5835a2b7-1466-4a21-a196-8ae965945758 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action" status: 200 len: 14 microversion: 2.1 time: 0.078493 Dec 15 13:09:50.586014 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 587/1113] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:09:50 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:09:50.631588 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-a78a7a58-67bd-4567-8392-a7ab761ae1e5 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 38262 microversion: 2.20 time: 0.094410 Dec 15 13:09:50.632252 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 527/1114] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:50 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 38262 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:09:51.593349 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1fcf7e49-ae56-4623-8462-fe137682a68a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:51.594387 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1fcf7e49-ae56-4623-8462-fe137682a68a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:51.601209 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1fcf7e49-ae56-4623-8462-fe137682a68a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:51.602181 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1fcf7e49-ae56-4623-8462-fe137682a68a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:51.602976 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1fcf7e49-ae56-4623-8462-fe137682a68a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:51.603416 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1fcf7e49-ae56-4623-8462-fe137682a68a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:51.645737 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-d5e71e49-6e32-4f42-91ec-2ee4304fddf1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:51.647033 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-d5e71e49-6e32-4f42-91ec-2ee4304fddf1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:51.654481 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d5e71e49-6e32-4f42-91ec-2ee4304fddf1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:51.654938 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d5e71e49-6e32-4f42-91ec-2ee4304fddf1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:51.655720 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d5e71e49-6e32-4f42-91ec-2ee4304fddf1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:51.656161 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d5e71e49-6e32-4f42-91ec-2ee4304fddf1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:51.677585 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1fcf7e49-ae56-4623-8462-fe137682a68a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action" status: 200 len: 9954 microversion: 2.1 time: 0.087957 Dec 15 13:09:51.682485 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 588/1115] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:09:51 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action => generated 9954 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:51.721835 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-d5e71e49-6e32-4f42-91ec-2ee4304fddf1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 38262 microversion: 2.20 time: 0.080287 Dec 15 13:09:51.722528 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 528/1116] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:51 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 38262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:09:52.695895 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f5c85a5d-50cb-4dcd-b6bf-e8f78126ee20 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:52.697142 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f5c85a5d-50cb-4dcd-b6bf-e8f78126ee20 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:52.717825 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f5c85a5d-50cb-4dcd-b6bf-e8f78126ee20 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:52.718761 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f5c85a5d-50cb-4dcd-b6bf-e8f78126ee20 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:52.719632 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f5c85a5d-50cb-4dcd-b6bf-e8f78126ee20 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:52.720144 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f5c85a5d-50cb-4dcd-b6bf-e8f78126ee20 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:52.734242 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-aa33ec98-ba9a-4c7c-be4d-ecbd5936dea1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:52.735360 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-aa33ec98-ba9a-4c7c-be4d-ecbd5936dea1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:52.742350 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-aa33ec98-ba9a-4c7c-be4d-ecbd5936dea1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:52.743459 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-aa33ec98-ba9a-4c7c-be4d-ecbd5936dea1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:52.744448 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-aa33ec98-ba9a-4c7c-be4d-ecbd5936dea1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:52.745082 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-aa33ec98-ba9a-4c7c-be4d-ecbd5936dea1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:52.799020 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f5c85a5d-50cb-4dcd-b6bf-e8f78126ee20 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action" status: 200 len: 17508 microversion: 2.1 time: 0.106965 Dec 15 13:09:52.799826 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 589/1117] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:09:52 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action => generated 17508 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:09:52.820713 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-aa33ec98-ba9a-4c7c-be4d-ecbd5936dea1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 38262 microversion: 2.20 time: 0.089873 Dec 15 13:09:52.821825 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 529/1118] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:52 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 38262 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:09:53.813484 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d6bfbe56-75d0-4da4-b7c8-133e1f7bac79 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:53.815066 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d6bfbe56-75d0-4da4-b7c8-133e1f7bac79 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:53.825008 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d6bfbe56-75d0-4da4-b7c8-133e1f7bac79 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:53.826034 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d6bfbe56-75d0-4da4-b7c8-133e1f7bac79 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:53.829695 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d6bfbe56-75d0-4da4-b7c8-133e1f7bac79 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:53.830327 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d6bfbe56-75d0-4da4-b7c8-133e1f7bac79 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:53.833374 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-235789e4-ed19-4462-bd9e-4820a466f424 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:53.835063 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-235789e4-ed19-4462-bd9e-4820a466f424 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:53.841707 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-235789e4-ed19-4462-bd9e-4820a466f424 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:53.842173 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-235789e4-ed19-4462-bd9e-4820a466f424 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:53.842968 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-235789e4-ed19-4462-bd9e-4820a466f424 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:53.843500 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-235789e4-ed19-4462-bd9e-4820a466f424 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:53.908821 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d6bfbe56-75d0-4da4-b7c8-133e1f7bac79 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action" status: 200 len: 18827 microversion: 2.1 time: 0.101223 Dec 15 13:09:53.914839 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 590/1119] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:09:53 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action => generated 18827 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:09:53.924692 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-235789e4-ed19-4462-bd9e-4820a466f424 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 38262 microversion: 2.20 time: 0.095264 Dec 15 13:09:53.925898 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 530/1120] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:53 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 38262 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:09:54.920920 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-17957c40-88e0-4b21-9ec6-552f443ad53f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:54.922387 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-17957c40-88e0-4b21-9ec6-552f443ad53f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:54.929807 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-17957c40-88e0-4b21-9ec6-552f443ad53f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:54.930521 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-17957c40-88e0-4b21-9ec6-552f443ad53f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:54.931457 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-17957c40-88e0-4b21-9ec6-552f443ad53f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:54.932057 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-17957c40-88e0-4b21-9ec6-552f443ad53f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:54.937965 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-a8830d24-28cf-4e24-ac5e-f8d822749d5a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:54.939061 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-a8830d24-28cf-4e24-ac5e-f8d822749d5a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:54.948779 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a8830d24-28cf-4e24-ac5e-f8d822749d5a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:54.951413 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a8830d24-28cf-4e24-ac5e-f8d822749d5a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:54.951576 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a8830d24-28cf-4e24-ac5e-f8d822749d5a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:54.958299 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a8830d24-28cf-4e24-ac5e-f8d822749d5a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:55.053631 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-17957c40-88e0-4b21-9ec6-552f443ad53f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action" status: 200 len: 21519 microversion: 2.1 time: 0.136659 Dec 15 13:09:55.057464 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 591/1121] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:09:54 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action => generated 21519 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:09:55.081441 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-a8830d24-28cf-4e24-ac5e-f8d822749d5a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 200 len: 38403 microversion: 2.20 time: 0.147069 Dec 15 13:09:55.082458 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 531/1122] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:09:54 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 38403 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:09:55.094334 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-66321205-11db-49c3-a120-733705bc3590 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:55.094914 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-66321205-11db-49c3-a120-733705bc3590 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:55.107390 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-66321205-11db-49c3-a120-733705bc3590 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:55.107839 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-66321205-11db-49c3-a120-733705bc3590 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:55.108638 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-66321205-11db-49c3-a120-733705bc3590 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:55.109075 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-66321205-11db-49c3-a120-733705bc3590 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:55.136406 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-66321205-11db-49c3-a120-733705bc3590 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/ips" status: 200 len: 150 microversion: 2.20 time: 0.046305 Dec 15 13:09:55.137081 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 592/1123] 10.222.0.57 () {60 vars in 1288 bytes} [Wed Dec 15 13:09:55 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/ips => generated 150 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:09:56.066466 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-6ee1ae02-1127-4270-a957-6b4da7c1be63 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:56.067493 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-6ee1ae02-1127-4270-a957-6b4da7c1be63 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:56.087274 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6ee1ae02-1127-4270-a957-6b4da7c1be63 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:56.087718 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6ee1ae02-1127-4270-a957-6b4da7c1be63 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:56.090466 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6ee1ae02-1127-4270-a957-6b4da7c1be63 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:56.093423 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6ee1ae02-1127-4270-a957-6b4da7c1be63 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:56.168188 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-6ee1ae02-1127-4270-a957-6b4da7c1be63 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action" status: 200 len: 23228 microversion: 2.1 time: 0.106541 Dec 15 13:09:56.168870 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 532/1124] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:09:56 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action => generated 23228 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:09:57.180525 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e120e7c3-e915-4a02-ae5c-07980f1599d5 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:57.182686 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e120e7c3-e915-4a02-ae5c-07980f1599d5 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:57.191606 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e120e7c3-e915-4a02-ae5c-07980f1599d5 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:57.192482 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e120e7c3-e915-4a02-ae5c-07980f1599d5 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:57.194615 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e120e7c3-e915-4a02-ae5c-07980f1599d5 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:57.195432 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e120e7c3-e915-4a02-ae5c-07980f1599d5 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:57.280563 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e120e7c3-e915-4a02-ae5c-07980f1599d5 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action" status: 200 len: 24621 microversion: 2.1 time: 0.103787 Dec 15 13:09:57.285116 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 593/1125] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:09:57 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action => generated 24621 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:09:58.294333 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-64da43d7-fc18-4c06-8e95-c0811f38ba09 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:58.295593 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-64da43d7-fc18-4c06-8e95-c0811f38ba09 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:58.305410 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-64da43d7-fc18-4c06-8e95-c0811f38ba09 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:58.306485 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-64da43d7-fc18-4c06-8e95-c0811f38ba09 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:58.307326 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-64da43d7-fc18-4c06-8e95-c0811f38ba09 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:58.307757 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-64da43d7-fc18-4c06-8e95-c0811f38ba09 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:58.394123 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-64da43d7-fc18-4c06-8e95-c0811f38ba09 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action" status: 200 len: 26267 microversion: 2.1 time: 0.103667 Dec 15 13:09:58.399186 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 533/1126] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:09:58 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action => generated 26267 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:09:59.407457 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e5e51a4f-fb24-42bc-a2a9-422137867557 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:59.408550 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e5e51a4f-fb24-42bc-a2a9-422137867557 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:59.416020 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e5e51a4f-fb24-42bc-a2a9-422137867557 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:59.416596 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e5e51a4f-fb24-42bc-a2a9-422137867557 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:59.417458 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e5e51a4f-fb24-42bc-a2a9-422137867557 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:59.417963 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e5e51a4f-fb24-42bc-a2a9-422137867557 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:59.502735 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e5e51a4f-fb24-42bc-a2a9-422137867557 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action" status: 200 len: 27512 microversion: 2.1 time: 0.099862 Dec 15 13:09:59.503853 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 594/1127] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:09:59 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action => generated 27512 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:10:00.518349 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-ff16dc5f-b798-4926-b69a-2d47b4c2cf59 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:10:00.520225 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-ff16dc5f-b798-4926-b69a-2d47b4c2cf59 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:00.528149 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ff16dc5f-b798-4926-b69a-2d47b4c2cf59 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:00.528700 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ff16dc5f-b798-4926-b69a-2d47b4c2cf59 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:00.529587 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ff16dc5f-b798-4926-b69a-2d47b4c2cf59 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:00.530118 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ff16dc5f-b798-4926-b69a-2d47b4c2cf59 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:00.630564 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-ff16dc5f-b798-4926-b69a-2d47b4c2cf59 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action" status: 200 len: 28018 microversion: 2.1 time: 0.109755 Dec 15 13:10:00.632138 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 534/1128] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:10:00 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action => generated 28018 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:10:01.645777 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-00df9a6d-a796-4c46-adbe-5eac58e71abd tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:10:01.648408 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-00df9a6d-a796-4c46-adbe-5eac58e71abd tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:01.656585 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-00df9a6d-a796-4c46-adbe-5eac58e71abd tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:01.657428 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-00df9a6d-a796-4c46-adbe-5eac58e71abd tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:01.658400 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-00df9a6d-a796-4c46-adbe-5eac58e71abd tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:01.659021 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-00df9a6d-a796-4c46-adbe-5eac58e71abd tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:01.778868 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-00df9a6d-a796-4c46-adbe-5eac58e71abd tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action" status: 200 len: 28204 microversion: 2.1 time: 0.132040 Dec 15 13:10:01.780463 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 595/1129] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:10:01 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action => generated 28204 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:10:02.792748 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-bad57d8b-9314-4ca4-982d-8d9d7f060a51 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:10:02.794548 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-bad57d8b-9314-4ca4-982d-8d9d7f060a51 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:02.807218 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-bad57d8b-9314-4ca4-982d-8d9d7f060a51 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:02.809583 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-bad57d8b-9314-4ca4-982d-8d9d7f060a51 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:02.811623 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-bad57d8b-9314-4ca4-982d-8d9d7f060a51 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:02.817620 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-bad57d8b-9314-4ca4-982d-8d9d7f060a51 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:02.951128 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-bad57d8b-9314-4ca4-982d-8d9d7f060a51 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action" status: 200 len: 28347 microversion: 2.1 time: 0.163136 Dec 15 13:10:02.953280 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 535/1130] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:10:02 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action => generated 28347 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:10:03.965990 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8a6df771-46a3-42c5-9059-ad47a67cd861 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:10:03.967052 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8a6df771-46a3-42c5-9059-ad47a67cd861 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:03.979237 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8a6df771-46a3-42c5-9059-ad47a67cd861 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:03.979891 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8a6df771-46a3-42c5-9059-ad47a67cd861 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:03.980707 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8a6df771-46a3-42c5-9059-ad47a67cd861 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:03.981140 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8a6df771-46a3-42c5-9059-ad47a67cd861 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:04.070500 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8a6df771-46a3-42c5-9059-ad47a67cd861 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action" status: 200 len: 28663 microversion: 2.1 time: 0.110269 Dec 15 13:10:04.071150 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 596/1131] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:10:03 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action => generated 28663 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:10:04.281036 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-efdc84c3-bcb4-41e0-9b26-0d05996dd01e tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Action: 'create', calling method: .version_select at 0x7faf1c012d30>, body: {"keypair": {"name": "tempest-TestShelveInstance-1186721875"}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:10:04.295504 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-efdc84c3-bcb4-41e0-9b26-0d05996dd01e tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Getting quotas for project 8d6505d138c547538566bf960f213d4a. Resources: {'key_pairs'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:10:04.300553 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-efdc84c3-bcb4-41e0-9b26-0d05996dd01e tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Getting quotas for user c53181e8b308404185e2c38749ee619b and project 8d6505d138c547538566bf960f213d4a. Resources: {'key_pairs'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:10:04.971609 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-efdc84c3-bcb4-41e0-9b26-0d05996dd01e tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Getting quotas for project 8d6505d138c547538566bf960f213d4a. Resources: {'key_pairs'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:10:04.988256 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-efdc84c3-bcb4-41e0-9b26-0d05996dd01e tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Getting quotas for user c53181e8b308404185e2c38749ee619b and project 8d6505d138c547538566bf960f213d4a. Resources: {'key_pairs'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:10:05.009750 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-efdc84c3-bcb4-41e0-9b26-0d05996dd01e tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.895863 Dec 15 13:10:05.010470 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 536/1132] 10.222.0.57 () {60 vars in 1157 bytes} [Wed Dec 15 13:10:04 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:05.084254 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-79d24911-85cb-4f27-bc01-b1ead232ba53 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:10:05.086126 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-79d24911-85cb-4f27-bc01-b1ead232ba53 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:05.093564 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-79d24911-85cb-4f27-bc01-b1ead232ba53 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:05.094312 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-79d24911-85cb-4f27-bc01-b1ead232ba53 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:05.095192 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-79d24911-85cb-4f27-bc01-b1ead232ba53 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:05.095749 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-79d24911-85cb-4f27-bc01-b1ead232ba53 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:05.181982 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-79d24911-85cb-4f27-bc01-b1ead232ba53 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action" status: 200 len: 28663 microversion: 2.1 time: 0.102822 Dec 15 13:10:05.182946 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 597/1133] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:10:05 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action => generated 28663 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:10:06.197969 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-23971c38-e421-4533-a8d1-d92988223ad7 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:10:06.199168 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-23971c38-e421-4533-a8d1-d92988223ad7 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:06.207607 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-23971c38-e421-4533-a8d1-d92988223ad7 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:06.208553 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-23971c38-e421-4533-a8d1-d92988223ad7 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:06.209639 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-23971c38-e421-4533-a8d1-d92988223ad7 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:06.210314 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-23971c38-e421-4533-a8d1-d92988223ad7 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:06.305352 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-23971c38-e421-4533-a8d1-d92988223ad7 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action" status: 200 len: 28663 microversion: 2.1 time: 0.111463 Dec 15 13:10:06.306302 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 537/1134] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:10:06 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action => generated 28663 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:10:07.317284 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-72435eac-0d11-4c56-b83b-26f4d45e349e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:10:07.318317 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-72435eac-0d11-4c56-b83b-26f4d45e349e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:07.326672 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-72435eac-0d11-4c56-b83b-26f4d45e349e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:07.327123 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-72435eac-0d11-4c56-b83b-26f4d45e349e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:07.327953 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-72435eac-0d11-4c56-b83b-26f4d45e349e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:07.328385 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-72435eac-0d11-4c56-b83b-26f4d45e349e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:07.415661 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-72435eac-0d11-4c56-b83b-26f4d45e349e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action" status: 200 len: 28832 microversion: 2.1 time: 0.102220 Dec 15 13:10:07.416505 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 598/1135] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:10:07 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action => generated 28832 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:10:08.428224 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-0e86606b-b75f-4acd-825c-728a20199d87 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:10:08.429548 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-0e86606b-b75f-4acd-825c-728a20199d87 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:08.441268 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0e86606b-b75f-4acd-825c-728a20199d87 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:08.441718 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0e86606b-b75f-4acd-825c-728a20199d87 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:08.442537 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0e86606b-b75f-4acd-825c-728a20199d87 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:08.443163 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0e86606b-b75f-4acd-825c-728a20199d87 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:08.536478 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-0e86606b-b75f-4acd-825c-728a20199d87 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action" status: 200 len: 30907 microversion: 2.1 time: 0.112092 Dec 15 13:10:08.537106 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 538/1136] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:10:08 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action => generated 30907 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:10:09.547765 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-205c3333-29ab-411a-9dc4-0d75c65e7c66 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:10:09.548801 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-205c3333-29ab-411a-9dc4-0d75c65e7c66 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:09.556211 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-205c3333-29ab-411a-9dc4-0d75c65e7c66 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:09.556656 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-205c3333-29ab-411a-9dc4-0d75c65e7c66 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:09.557475 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-205c3333-29ab-411a-9dc4-0d75c65e7c66 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:09.557888 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-205c3333-29ab-411a-9dc4-0d75c65e7c66 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:09.629987 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-205c3333-29ab-411a-9dc4-0d75c65e7c66 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action" status: 200 len: 32657 microversion: 2.1 time: 0.085894 Dec 15 13:10:09.630526 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 599/1137] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:10:09 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action => generated 32657 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:10:10.642505 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-f5bbd778-a205-47a5-ba33-e2220c6dde64 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:10:10.644262 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-f5bbd778-a205-47a5-ba33-e2220c6dde64 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:10.651693 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f5bbd778-a205-47a5-ba33-e2220c6dde64 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:10.652148 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f5bbd778-a205-47a5-ba33-e2220c6dde64 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:10.652938 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f5bbd778-a205-47a5-ba33-e2220c6dde64 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:10.653376 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f5bbd778-a205-47a5-ba33-e2220c6dde64 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:10.731414 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-f5bbd778-a205-47a5-ba33-e2220c6dde64 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action" status: 200 len: 33656 microversion: 2.1 time: 0.092869 Dec 15 13:10:10.732061 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 539/1138] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:10:10 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action => generated 33656 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:10:11.744334 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a612db31-4473-40c9-89eb-daf7b2928cfe tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:10:11.745169 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a612db31-4473-40c9-89eb-daf7b2928cfe tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:11.752065 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a612db31-4473-40c9-89eb-daf7b2928cfe tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:11.752533 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a612db31-4473-40c9-89eb-daf7b2928cfe tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:11.753305 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a612db31-4473-40c9-89eb-daf7b2928cfe tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:11.753735 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a612db31-4473-40c9-89eb-daf7b2928cfe tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:11.829981 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a612db31-4473-40c9-89eb-daf7b2928cfe tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action" status: 200 len: 34586 microversion: 2.1 time: 0.090242 Dec 15 13:10:11.830652 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 600/1139] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:10:11 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action => generated 34586 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:10:12.832360 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-fed34a93-12e3-476e-b733-9caf005bcd6d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:10:12.832984 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-fed34a93-12e3-476e-b733-9caf005bcd6d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:12.840375 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fed34a93-12e3-476e-b733-9caf005bcd6d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:12.840831 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fed34a93-12e3-476e-b733-9caf005bcd6d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:12.841608 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fed34a93-12e3-476e-b733-9caf005bcd6d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:12.841718 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f5a11eb2-33b3-4cf4-b192-2e711f2d229b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:10:12.842134 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-fed34a93-12e3-476e-b733-9caf005bcd6d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:12.842636 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f5a11eb2-33b3-4cf4-b192-2e711f2d229b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:12.849328 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f5a11eb2-33b3-4cf4-b192-2e711f2d229b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:12.849775 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f5a11eb2-33b3-4cf4-b192-2e711f2d229b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:12.851155 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f5a11eb2-33b3-4cf4-b192-2e711f2d229b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:12.851592 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f5a11eb2-33b3-4cf4-b192-2e711f2d229b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:12.865631 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.objects.instance [None req-fed34a93-12e3-476e-b733-9caf005bcd6d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lazy-loading 'flavor' on Instance uuid 5328000e-dd8e-4bff-b035-2114c746691a {{(pid=116097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:10:12.923843 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f5a11eb2-33b3-4cf4-b192-2e711f2d229b tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action" status: 200 len: 35500 microversion: 2.1 time: 0.085901 Dec 15 13:10:12.925863 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 601/1140] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:10:12 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action => generated 35500 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:10:13.132633 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-fed34a93-12e3-476e-b733-9caf005bcd6d tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 202 len: 0 microversion: 2.20 time: 0.304171 Dec 15 13:10:13.133269 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 540/1141] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:10:12 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:10:13.142054 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9286965e-1b1b-4aac-babc-3d308102b7c7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:13.142773 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9286965e-1b1b-4aac-babc-3d308102b7c7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:13.150248 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9286965e-1b1b-4aac-babc-3d308102b7c7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:13.150726 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9286965e-1b1b-4aac-babc-3d308102b7c7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:13.151491 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9286965e-1b1b-4aac-babc-3d308102b7c7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:13.151929 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9286965e-1b1b-4aac-babc-3d308102b7c7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:13.289405 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-9286965e-1b1b-4aac-babc-3d308102b7c7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:13.298495 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-9286965e-1b1b-4aac-babc-3d308102b7c7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:13.300094 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-9286965e-1b1b-4aac-babc-3d308102b7c7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:13.301312 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9286965e-1b1b-4aac-babc-3d308102b7c7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1722 microversion: 2.20 time: 0.163297 Dec 15 13:10:13.301899 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 602/1142] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:13 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:10:13.937220 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-b4c35680-50ef-4bcf-babc-fc991583af3f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:10:13.938221 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-b4c35680-50ef-4bcf-babc-fc991583af3f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:13.944765 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b4c35680-50ef-4bcf-babc-fc991583af3f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:13.945208 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b4c35680-50ef-4bcf-babc-fc991583af3f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:13.945974 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b4c35680-50ef-4bcf-babc-fc991583af3f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:13.946432 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b4c35680-50ef-4bcf-babc-fc991583af3f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:14.020470 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-b4c35680-50ef-4bcf-babc-fc991583af3f tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action" status: 200 len: 36841 microversion: 2.1 time: 0.087179 Dec 15 13:10:14.020768 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 541/1143] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:10:13 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action => generated 36841 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:10:14.321248 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8e9317b1-cfe9-4320-98db-53eac05e68ec tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:14.321768 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8e9317b1-cfe9-4320-98db-53eac05e68ec tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:14.328021 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8e9317b1-cfe9-4320-98db-53eac05e68ec tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:14.328461 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8e9317b1-cfe9-4320-98db-53eac05e68ec tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:14.329223 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8e9317b1-cfe9-4320-98db-53eac05e68ec tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:14.329651 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8e9317b1-cfe9-4320-98db-53eac05e68ec tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:14.461136 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8e9317b1-cfe9-4320-98db-53eac05e68ec tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:14.469317 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8e9317b1-cfe9-4320-98db-53eac05e68ec tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:14.470929 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8e9317b1-cfe9-4320-98db-53eac05e68ec tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:14.472109 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8e9317b1-cfe9-4320-98db-53eac05e68ec tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1722 microversion: 2.20 time: 0.155299 Dec 15 13:10:14.472675 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 603/1144] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:14 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:10:15.033306 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-14cabd86-938e-4fe5-b6b7-dbcab129c555 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:10:15.034341 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-14cabd86-938e-4fe5-b6b7-dbcab129c555 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:15.041752 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-14cabd86-938e-4fe5-b6b7-dbcab129c555 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:15.042224 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-14cabd86-938e-4fe5-b6b7-dbcab129c555 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:15.042999 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-14cabd86-938e-4fe5-b6b7-dbcab129c555 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:15.043435 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-14cabd86-938e-4fe5-b6b7-dbcab129c555 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:15.127049 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-14cabd86-938e-4fe5-b6b7-dbcab129c555 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action" status: 200 len: 38059 microversion: 2.1 time: 0.097596 Dec 15 13:10:15.127782 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 542/1145] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:10:15 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action => generated 38059 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:10:15.490702 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-26576397-fa75-4f02-89b7-b226e475f757 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:15.491299 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-26576397-fa75-4f02-89b7-b226e475f757 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:15.497898 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-26576397-fa75-4f02-89b7-b226e475f757 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:15.498376 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-26576397-fa75-4f02-89b7-b226e475f757 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:15.499164 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-26576397-fa75-4f02-89b7-b226e475f757 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:15.499595 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-26576397-fa75-4f02-89b7-b226e475f757 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:15.641324 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-26576397-fa75-4f02-89b7-b226e475f757 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:15.649483 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-26576397-fa75-4f02-89b7-b226e475f757 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:15.651008 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-26576397-fa75-4f02-89b7-b226e475f757 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:15.652171 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-26576397-fa75-4f02-89b7-b226e475f757 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1722 microversion: 2.20 time: 0.165325 Dec 15 13:10:15.652712 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 604/1146] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:15 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:10:16.140483 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-05f17c07-0911-480e-8f25-0f73d8c5fe47 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:10:16.141479 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-05f17c07-0911-480e-8f25-0f73d8c5fe47 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:16.148025 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-05f17c07-0911-480e-8f25-0f73d8c5fe47 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:16.148471 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-05f17c07-0911-480e-8f25-0f73d8c5fe47 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:16.149246 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-05f17c07-0911-480e-8f25-0f73d8c5fe47 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:16.149676 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-05f17c07-0911-480e-8f25-0f73d8c5fe47 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:16.379602 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-05f17c07-0911-480e-8f25-0f73d8c5fe47 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action" status: 200 len: 38193 microversion: 2.1 time: 0.243037 Dec 15 13:10:16.380210 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 543/1147] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:10:16 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action => generated 38193 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:10:16.669791 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-97e07baa-c3eb-43a4-adbc-7fa438a64526 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:16.670442 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-97e07baa-c3eb-43a4-adbc-7fa438a64526 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:16.676609 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-97e07baa-c3eb-43a4-adbc-7fa438a64526 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:16.677052 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-97e07baa-c3eb-43a4-adbc-7fa438a64526 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:16.677814 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-97e07baa-c3eb-43a4-adbc-7fa438a64526 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:16.678761 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-97e07baa-c3eb-43a4-adbc-7fa438a64526 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:16.810130 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-97e07baa-c3eb-43a4-adbc-7fa438a64526 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:16.823871 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-97e07baa-c3eb-43a4-adbc-7fa438a64526 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:16.826818 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-97e07baa-c3eb-43a4-adbc-7fa438a64526 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:16.828948 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-97e07baa-c3eb-43a4-adbc-7fa438a64526 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1722 microversion: 2.20 time: 0.162540 Dec 15 13:10:16.829952 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 605/1148] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:16 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:10:17.392030 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-42446da1-c540-404f-8db3-4b2853a34f20 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:10:17.393058 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-42446da1-c540-404f-8db3-4b2853a34f20 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:17.400459 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-42446da1-c540-404f-8db3-4b2853a34f20 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:17.400918 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-42446da1-c540-404f-8db3-4b2853a34f20 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:17.401718 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-42446da1-c540-404f-8db3-4b2853a34f20 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:17.402174 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-42446da1-c540-404f-8db3-4b2853a34f20 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:17.462030 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-42446da1-c540-404f-8db3-4b2853a34f20 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action" status: 200 len: 38193 microversion: 2.1 time: 0.073774 Dec 15 13:10:17.462609 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 544/1149] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:10:17 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action => generated 38193 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:10:17.857344 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b782beb5-406b-453b-89cd-c542aa0bae3a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:17.857947 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b782beb5-406b-453b-89cd-c542aa0bae3a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:17.864402 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b782beb5-406b-453b-89cd-c542aa0bae3a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:17.864850 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b782beb5-406b-453b-89cd-c542aa0bae3a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:17.866360 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b782beb5-406b-453b-89cd-c542aa0bae3a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:17.866790 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b782beb5-406b-453b-89cd-c542aa0bae3a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:17.997836 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b782beb5-406b-453b-89cd-c542aa0bae3a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:18.005682 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b782beb5-406b-453b-89cd-c542aa0bae3a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:18.007228 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b782beb5-406b-453b-89cd-c542aa0bae3a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:18.008381 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b782beb5-406b-453b-89cd-c542aa0bae3a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1722 microversion: 2.20 time: 0.155481 Dec 15 13:10:18.008930 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 606/1150] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:17 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:10:18.474283 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-3fef7b65-ce96-43af-ba04-5aaaa526ed46 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:10:18.475329 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-3fef7b65-ce96-43af-ba04-5aaaa526ed46 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:18.482122 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3fef7b65-ce96-43af-ba04-5aaaa526ed46 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:18.482605 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3fef7b65-ce96-43af-ba04-5aaaa526ed46 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:18.483391 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3fef7b65-ce96-43af-ba04-5aaaa526ed46 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:18.483830 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3fef7b65-ce96-43af-ba04-5aaaa526ed46 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:18.542761 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-3fef7b65-ce96-43af-ba04-5aaaa526ed46 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action" status: 200 len: 38193 microversion: 2.1 time: 0.072319 Dec 15 13:10:18.543403 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 545/1151] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:10:18 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action => generated 38193 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:10:19.025747 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-02e740cd-2793-45e6-8ad8-7d466ffa82e2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:19.026388 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-02e740cd-2793-45e6-8ad8-7d466ffa82e2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:19.032641 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-02e740cd-2793-45e6-8ad8-7d466ffa82e2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:19.033082 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-02e740cd-2793-45e6-8ad8-7d466ffa82e2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:19.033856 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-02e740cd-2793-45e6-8ad8-7d466ffa82e2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:19.034322 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-02e740cd-2793-45e6-8ad8-7d466ffa82e2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:19.161668 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-02e740cd-2793-45e6-8ad8-7d466ffa82e2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:19.169729 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-02e740cd-2793-45e6-8ad8-7d466ffa82e2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:19.171241 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-02e740cd-2793-45e6-8ad8-7d466ffa82e2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:19.172379 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-02e740cd-2793-45e6-8ad8-7d466ffa82e2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1722 microversion: 2.20 time: 0.150373 Dec 15 13:10:19.172927 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 607/1152] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:19 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:10:19.555050 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-54cb03f3-02a0-4fde-a547-e6e358d4b6a1 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:10:19.556039 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-54cb03f3-02a0-4fde-a547-e6e358d4b6a1 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:19.562810 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-54cb03f3-02a0-4fde-a547-e6e358d4b6a1 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:19.563258 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-54cb03f3-02a0-4fde-a547-e6e358d4b6a1 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:19.564023 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-54cb03f3-02a0-4fde-a547-e6e358d4b6a1 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:19.564458 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-54cb03f3-02a0-4fde-a547-e6e358d4b6a1 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:19.637259 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-54cb03f3-02a0-4fde-a547-e6e358d4b6a1 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action" status: 200 len: 38322 microversion: 2.1 time: 0.085998 Dec 15 13:10:19.637790 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 546/1153] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:10:19 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/action => generated 38322 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:10:19.647903 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-adbfbd12-316f-4614-8597-47664ced1958 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:19.648393 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-adbfbd12-316f-4614-8597-47664ced1958 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:19.654168 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-adbfbd12-316f-4614-8597-47664ced1958 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:19.654627 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-adbfbd12-316f-4614-8597-47664ced1958 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:19.655392 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-adbfbd12-316f-4614-8597-47664ced1958 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:19.655825 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-adbfbd12-316f-4614-8597-47664ced1958 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:19.678562 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-adbfbd12-316f-4614-8597-47664ced1958 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/ips" status: 200 len: 146 microversion: 2.1 time: 0.034820 Dec 15 13:10:19.679096 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 608/1154] 10.222.0.57 () {58 vars in 1247 bytes} [Wed Dec 15 13:10:19 2021] GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/ips => generated 146 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:10:20.191458 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-a9ab5e62-9fff-4ecf-ab63-e25f32455aec tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:20.192093 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-a9ab5e62-9fff-4ecf-ab63-e25f32455aec tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:20.198772 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a9ab5e62-9fff-4ecf-ab63-e25f32455aec tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:20.199226 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a9ab5e62-9fff-4ecf-ab63-e25f32455aec tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:20.199988 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a9ab5e62-9fff-4ecf-ab63-e25f32455aec tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:20.200418 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a9ab5e62-9fff-4ecf-ab63-e25f32455aec tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:20.329813 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-a9ab5e62-9fff-4ecf-ab63-e25f32455aec tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:20.338464 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-a9ab5e62-9fff-4ecf-ab63-e25f32455aec tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:20.339961 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-a9ab5e62-9fff-4ecf-ab63-e25f32455aec tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:20.341113 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-a9ab5e62-9fff-4ecf-ab63-e25f32455aec tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1722 microversion: 2.20 time: 0.153811 Dec 15 13:10:20.341757 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 547/1155] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:20 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:10:20.969483 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-eac4c33a-c4e6-47fc-afa8-cd91b7f2b3ea tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8fb01cac-6b4e-4b68-ba6f-83705831deca"}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:10:20.970648 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-eac4c33a-c4e6-47fc-afa8-cd91b7f2b3ea tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:20.979167 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eac4c33a-c4e6-47fc-afa8-cd91b7f2b3ea tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:20.979985 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eac4c33a-c4e6-47fc-afa8-cd91b7f2b3ea tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:20.980947 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eac4c33a-c4e6-47fc-afa8-cd91b7f2b3ea tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:20.981383 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eac4c33a-c4e6-47fc-afa8-cd91b7f2b3ea tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:21.206827 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-eac4c33a-c4e6-47fc-afa8-cd91b7f2b3ea tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.240833 Dec 15 13:10:21.207406 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 609/1156] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Dec 15 13:10:20 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/os-volume_attachments => generated 194 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:10:21.360448 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-50a677cf-16c6-437b-9aea-a31f8438c72f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:21.361160 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-50a677cf-16c6-437b-9aea-a31f8438c72f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:21.368520 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-50a677cf-16c6-437b-9aea-a31f8438c72f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:21.368900 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-50a677cf-16c6-437b-9aea-a31f8438c72f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:21.369678 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-50a677cf-16c6-437b-9aea-a31f8438c72f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:21.370111 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-50a677cf-16c6-437b-9aea-a31f8438c72f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:21.497050 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-50a677cf-16c6-437b-9aea-a31f8438c72f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:21.504779 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-50a677cf-16c6-437b-9aea-a31f8438c72f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:21.506726 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-50a677cf-16c6-437b-9aea-a31f8438c72f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:21.507889 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-50a677cf-16c6-437b-9aea-a31f8438c72f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1722 microversion: 2.20 time: 0.151721 Dec 15 13:10:21.508416 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 548/1157] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:21 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:10:22.465032 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-84ae9209-4cbe-4cfe-9a88-571ab0277953 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1393223218", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1186721875", "security_groups": [{"name": "tempest-secgroup-smoke-850170722"}], "networks": [{"uuid": "82ffa701-54e7-42ad-8e18-cc6c4a5a47af"}], "block_device_mapping_v2": [{"uuid": "1a65ecd5-9c25-428e-b197-548cb70dd86a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:10:22.526046 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-ba43edca-cb71-4967-9343-98a60130bec2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:22.526683 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-ba43edca-cb71-4967-9343-98a60130bec2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:22.533038 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ba43edca-cb71-4967-9343-98a60130bec2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:22.533492 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ba43edca-cb71-4967-9343-98a60130bec2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:22.534392 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ba43edca-cb71-4967-9343-98a60130bec2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:22.534739 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ba43edca-cb71-4967-9343-98a60130bec2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:22.578437 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.network.neutron [None req-84ae9209-4cbe-4cfe-9a88-571ab0277953 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] validate_networks() for [('82ffa701-54e7-42ad-8e18-cc6c4a5a47af', None, None, None, None, None)] {{(pid=116098) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:10:22.666021 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-ba43edca-cb71-4967-9343-98a60130bec2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:22.673684 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-ba43edca-cb71-4967-9343-98a60130bec2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:22.675186 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-ba43edca-cb71-4967-9343-98a60130bec2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:22.676394 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-ba43edca-cb71-4967-9343-98a60130bec2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1722 microversion: 2.20 time: 0.154047 Dec 15 13:10:22.676966 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 549/1158] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:22 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:10:22.934296 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-84ae9209-4cbe-4cfe-9a88-571ab0277953 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Flavor limits 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:10:22.934746 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-84ae9209-4cbe-4cfe-9a88-571ab0277953 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Image limits 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:10:22.935250 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-84ae9209-4cbe-4cfe-9a88-571ab0277953 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Flavor pref 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:10:22.935654 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-84ae9209-4cbe-4cfe-9a88-571ab0277953 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Image pref 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:10:22.936063 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-84ae9209-4cbe-4cfe-9a88-571ab0277953 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:10:22.945082 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-84ae9209-4cbe-4cfe-9a88-571ab0277953 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:22.945530 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-84ae9209-4cbe-4cfe-9a88-571ab0277953 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:22.946366 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-84ae9209-4cbe-4cfe-9a88-571ab0277953 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:22.946802 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-84ae9209-4cbe-4cfe-9a88-571ab0277953 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:22.963299 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-84ae9209-4cbe-4cfe-9a88-571ab0277953 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Getting quotas for project 8d6505d138c547538566bf960f213d4a. Resources: {'instances', 'cores', 'ram'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:10:22.967152 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-84ae9209-4cbe-4cfe-9a88-571ab0277953 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Getting quotas for user c53181e8b308404185e2c38749ee619b and project 8d6505d138c547538566bf960f213d4a. Resources: {'instances', 'cores', 'ram'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:10:23.019900 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-84ae9209-4cbe-4cfe-9a88-571ab0277953 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Going to run 1 instances... {{(pid=116098) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:10:23.022903 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-84ae9209-4cbe-4cfe-9a88-571ab0277953 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1a65ecd5-9c25-428e-b197-548cb70dd86a',volume_size=None,volume_type=None)] {{(pid=116098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:10:23.142263 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-84ae9209-4cbe-4cfe-9a88-571ab0277953 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.681184 Dec 15 13:10:23.143067 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 610/1159] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Dec 15 13:10:22 2021] POST /compute/v2.1/servers => generated 405 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:10:23.153468 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-d0137bd8-6ee3-4ab9-b3f8-9dd992ca82f5 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:23.154071 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-d0137bd8-6ee3-4ab9-b3f8-9dd992ca82f5 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:23.209405 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-d0137bd8-6ee3-4ab9-b3f8-9dd992ca82f5 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:23.216093 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-d0137bd8-6ee3-4ab9-b3f8-9dd992ca82f5 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1089 microversion: 2.1 time: 0.066264 Dec 15 13:10:23.217492 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 550/1160] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:23 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1089 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:23.695094 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-22139fb8-53e0-4936-b224-4027d7da243e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:23.695721 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-22139fb8-53e0-4936-b224-4027d7da243e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:23.701769 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-22139fb8-53e0-4936-b224-4027d7da243e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:23.702285 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-22139fb8-53e0-4936-b224-4027d7da243e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:23.703216 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-22139fb8-53e0-4936-b224-4027d7da243e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:23.703729 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-22139fb8-53e0-4936-b224-4027d7da243e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:23.833162 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-22139fb8-53e0-4936-b224-4027d7da243e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:23.840851 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-22139fb8-53e0-4936-b224-4027d7da243e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:23.842358 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-22139fb8-53e0-4936-b224-4027d7da243e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:23.843498 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-22139fb8-53e0-4936-b224-4027d7da243e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1722 microversion: 2.20 time: 0.152688 Dec 15 13:10:23.844051 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 611/1161] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:23 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:10:24.232797 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-271dcf11-7789-443a-b652-2f45cd11f482 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:24.233329 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-271dcf11-7789-443a-b652-2f45cd11f482 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:24.241973 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-271dcf11-7789-443a-b652-2f45cd11f482 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:24.242444 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-271dcf11-7789-443a-b652-2f45cd11f482 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:24.243231 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-271dcf11-7789-443a-b652-2f45cd11f482 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:24.243663 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-271dcf11-7789-443a-b652-2f45cd11f482 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:24.304782 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-271dcf11-7789-443a-b652-2f45cd11f482 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:24.312144 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-271dcf11-7789-443a-b652-2f45cd11f482 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1205 microversion: 2.1 time: 0.083134 Dec 15 13:10:24.312815 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 551/1162] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:24 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1205 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:24.861665 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-83f34f52-52e0-47c8-800f-2675f843efd2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:24.862219 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-83f34f52-52e0-47c8-800f-2675f843efd2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:24.869105 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-83f34f52-52e0-47c8-800f-2675f843efd2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:24.869554 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-83f34f52-52e0-47c8-800f-2675f843efd2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:24.870360 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-83f34f52-52e0-47c8-800f-2675f843efd2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:24.870814 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-83f34f52-52e0-47c8-800f-2675f843efd2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:25.096275 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-83f34f52-52e0-47c8-800f-2675f843efd2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:25.104230 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-83f34f52-52e0-47c8-800f-2675f843efd2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:25.105706 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-83f34f52-52e0-47c8-800f-2675f843efd2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:25.106896 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-83f34f52-52e0-47c8-800f-2675f843efd2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1722 microversion: 2.20 time: 0.249321 Dec 15 13:10:25.107455 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 612/1163] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:24 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:10:25.329785 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-e486cb97-88d1-4e80-9a23-1c6a0122d75e tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:25.330617 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-e486cb97-88d1-4e80-9a23-1c6a0122d75e tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:25.338018 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e486cb97-88d1-4e80-9a23-1c6a0122d75e tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:25.338732 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e486cb97-88d1-4e80-9a23-1c6a0122d75e tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:25.339598 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e486cb97-88d1-4e80-9a23-1c6a0122d75e tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:25.340042 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e486cb97-88d1-4e80-9a23-1c6a0122d75e tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:25.449478 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-d144e075-4a78-4c6a-997c-eb5226bdb2b2 req-d28cab78-64b4-46bb-97d7-743a39e08785 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "619e3772-5547-4f07-b126-5b6482ad8749", "tag": "22db1fdd-c799-4ae9-bc07-611872cd4207"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:10:25.464496 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:10:25.464496 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:10:25.480224 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-d144e075-4a78-4c6a-997c-eb5226bdb2b2 req-d28cab78-64b4-46bb-97d7-743a39e08785 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:25.480671 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-d144e075-4a78-4c6a-997c-eb5226bdb2b2 req-d28cab78-64b4-46bb-97d7-743a39e08785 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:25.486964 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-e486cb97-88d1-4e80-9a23-1c6a0122d75e tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:25.496036 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-e486cb97-88d1-4e80-9a23-1c6a0122d75e tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1272 microversion: 2.1 time: 0.169915 Dec 15 13:10:25.505297 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-d144e075-4a78-4c6a-997c-eb5226bdb2b2 req-d28cab78-64b4-46bb-97d7-743a39e08785 service nova] Creating event network-changed:22db1fdd-c799-4ae9-bc07-611872cd4207 for instance 619e3772-5547-4f07-b126-5b6482ad8749 on hv-cinder-81322 Dec 15 13:10:25.506130 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 552/1164] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:25 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1272 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:25.509734 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-d144e075-4a78-4c6a-997c-eb5226bdb2b2 req-d28cab78-64b4-46bb-97d7-743a39e08785 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072408 Dec 15 13:10:25.512409 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 613/1165] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:10:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:10:26.124621 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-9f986396-20ce-4701-85c9-cbc080bb51b3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:26.125219 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-9f986396-20ce-4701-85c9-cbc080bb51b3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:26.131498 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9f986396-20ce-4701-85c9-cbc080bb51b3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:26.131941 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9f986396-20ce-4701-85c9-cbc080bb51b3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:26.132717 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9f986396-20ce-4701-85c9-cbc080bb51b3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:26.133146 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9f986396-20ce-4701-85c9-cbc080bb51b3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:26.268154 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-9f986396-20ce-4701-85c9-cbc080bb51b3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:26.276675 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-9f986396-20ce-4701-85c9-cbc080bb51b3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:26.278386 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-9f986396-20ce-4701-85c9-cbc080bb51b3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:26.279563 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-9f986396-20ce-4701-85c9-cbc080bb51b3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1722 microversion: 2.20 time: 0.158619 Dec 15 13:10:26.280112 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 553/1166] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:26 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:10:26.513751 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-797cde80-8972-4f33-ad80-aa50810e8c39 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:26.514500 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-797cde80-8972-4f33-ad80-aa50810e8c39 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:26.522638 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-797cde80-8972-4f33-ad80-aa50810e8c39 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:26.523086 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-797cde80-8972-4f33-ad80-aa50810e8c39 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:26.523861 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-797cde80-8972-4f33-ad80-aa50810e8c39 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:26.524294 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-797cde80-8972-4f33-ad80-aa50810e8c39 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:26.657771 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-797cde80-8972-4f33-ad80-aa50810e8c39 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:26.664973 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-797cde80-8972-4f33-ad80-aa50810e8c39 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1272 microversion: 2.1 time: 0.155856 Dec 15 13:10:26.665526 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 614/1167] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:26 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1272 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:27.298329 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-50406f78-46d2-4390-81ac-00f8ce702afa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:27.298968 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-50406f78-46d2-4390-81ac-00f8ce702afa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:27.305892 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-50406f78-46d2-4390-81ac-00f8ce702afa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:27.306367 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-50406f78-46d2-4390-81ac-00f8ce702afa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:27.307162 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-50406f78-46d2-4390-81ac-00f8ce702afa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:27.307600 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-50406f78-46d2-4390-81ac-00f8ce702afa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:27.451912 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-50406f78-46d2-4390-81ac-00f8ce702afa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:27.460252 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-50406f78-46d2-4390-81ac-00f8ce702afa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:27.462007 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-50406f78-46d2-4390-81ac-00f8ce702afa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:27.463569 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-50406f78-46d2-4390-81ac-00f8ce702afa tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1722 microversion: 2.20 time: 0.169057 Dec 15 13:10:27.464172 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 554/1168] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:27 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:10:27.652054 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-71cb10ec-154f-4d93-9503-15feeb8c16cb tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:27.652963 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-71cb10ec-154f-4d93-9503-15feeb8c16cb tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:27.659162 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-71cb10ec-154f-4d93-9503-15feeb8c16cb tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:27.659609 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-71cb10ec-154f-4d93-9503-15feeb8c16cb tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:27.660376 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-71cb10ec-154f-4d93-9503-15feeb8c16cb tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:27.660809 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-71cb10ec-154f-4d93-9503-15feeb8c16cb tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:27.688035 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-05be8d7e-c2f5-4844-adf3-922715b3d004 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:27.688639 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-05be8d7e-c2f5-4844-adf3-922715b3d004 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:27.696078 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-05be8d7e-c2f5-4844-adf3-922715b3d004 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:27.696613 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-05be8d7e-c2f5-4844-adf3-922715b3d004 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:27.697535 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-05be8d7e-c2f5-4844-adf3-922715b3d004 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:27.698105 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-05be8d7e-c2f5-4844-adf3-922715b3d004 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:27.705353 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-71cb10ec-154f-4d93-9503-15feeb8c16cb tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057102 Dec 15 13:10:27.710588 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 615/1169] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:10:27 2021] GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:10:27.716351 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4eca856c-23d7-4911-a514-a4416cb2b2c5 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:27.716875 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4eca856c-23d7-4911-a514-a4416cb2b2c5 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:27.725564 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4eca856c-23d7-4911-a514-a4416cb2b2c5 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:27.726760 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4eca856c-23d7-4911-a514-a4416cb2b2c5 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:27.728425 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4eca856c-23d7-4911-a514-a4416cb2b2c5 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:27.730878 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4eca856c-23d7-4911-a514-a4416cb2b2c5 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:27.777503 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4eca856c-23d7-4911-a514-a4416cb2b2c5 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/os-volume_attachments/8fb01cac-6b4e-4b68-ba6f-83705831deca" status: 200 len: 194 microversion: 2.1 time: 0.065641 Dec 15 13:10:27.778388 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 616/1170] 10.222.0.57 () {58 vars in 1412 bytes} [Wed Dec 15 13:10:27 2021] GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/os-volume_attachments/8fb01cac-6b4e-4b68-ba6f-83705831deca => generated 194 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:10:27.857650 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-05be8d7e-c2f5-4844-adf3-922715b3d004 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:27.866323 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-05be8d7e-c2f5-4844-adf3-922715b3d004 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1272 microversion: 2.1 time: 0.189028 Dec 15 13:10:27.866875 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 555/1171] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:27 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1272 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:28.481330 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-31309055-9fd3-4293-b915-abea6bdad7d1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:28.481923 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-31309055-9fd3-4293-b915-abea6bdad7d1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:28.487775 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-31309055-9fd3-4293-b915-abea6bdad7d1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:28.488210 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-31309055-9fd3-4293-b915-abea6bdad7d1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:28.488994 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-31309055-9fd3-4293-b915-abea6bdad7d1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:28.489420 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-31309055-9fd3-4293-b915-abea6bdad7d1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:28.617624 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-31309055-9fd3-4293-b915-abea6bdad7d1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:28.625260 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-31309055-9fd3-4293-b915-abea6bdad7d1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:28.626778 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-31309055-9fd3-4293-b915-abea6bdad7d1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:28.627917 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-31309055-9fd3-4293-b915-abea6bdad7d1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1722 microversion: 2.20 time: 0.150302 Dec 15 13:10:28.628456 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 617/1172] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:28 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:10:28.881953 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-7074b584-a853-4b07-84ea-cd49e80b3bc1 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:28.882592 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-7074b584-a853-4b07-84ea-cd49e80b3bc1 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:28.889079 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7074b584-a853-4b07-84ea-cd49e80b3bc1 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:28.889531 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7074b584-a853-4b07-84ea-cd49e80b3bc1 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:28.890342 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7074b584-a853-4b07-84ea-cd49e80b3bc1 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:28.890784 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7074b584-a853-4b07-84ea-cd49e80b3bc1 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:29.023827 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-7074b584-a853-4b07-84ea-cd49e80b3bc1 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:29.031101 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-7074b584-a853-4b07-84ea-cd49e80b3bc1 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1260 microversion: 2.1 time: 0.152814 Dec 15 13:10:29.031660 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 556/1173] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:28 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:29.102472 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-cefdcee4-5ab8-45bb-ae21-31b937cf41e1 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9ffc66f-97ff-4a71-a93a-a823dbf7ecfc"}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:10:29.103508 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-cefdcee4-5ab8-45bb-ae21-31b937cf41e1 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:29.109813 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cefdcee4-5ab8-45bb-ae21-31b937cf41e1 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:29.110285 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cefdcee4-5ab8-45bb-ae21-31b937cf41e1 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:29.111072 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cefdcee4-5ab8-45bb-ae21-31b937cf41e1 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:29.111499 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cefdcee4-5ab8-45bb-ae21-31b937cf41e1 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:29.343720 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-cefdcee4-5ab8-45bb-ae21-31b937cf41e1 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.245211 Dec 15 13:10:29.344335 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 618/1174] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Dec 15 13:10:29 2021] POST /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/os-volume_attachments => generated 194 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:10:29.647031 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-9c8e8c29-c3ad-4a32-8e4d-18a21598dbd3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:29.647636 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-9c8e8c29-c3ad-4a32-8e4d-18a21598dbd3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:29.653825 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9c8e8c29-c3ad-4a32-8e4d-18a21598dbd3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:29.654292 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9c8e8c29-c3ad-4a32-8e4d-18a21598dbd3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:29.655075 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9c8e8c29-c3ad-4a32-8e4d-18a21598dbd3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:29.655503 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9c8e8c29-c3ad-4a32-8e4d-18a21598dbd3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:29.787202 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-9c8e8c29-c3ad-4a32-8e4d-18a21598dbd3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:29.795026 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-9c8e8c29-c3ad-4a32-8e4d-18a21598dbd3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:29.796523 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-9c8e8c29-c3ad-4a32-8e4d-18a21598dbd3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:29.797705 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-9c8e8c29-c3ad-4a32-8e4d-18a21598dbd3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1722 microversion: 2.20 time: 0.154419 Dec 15 13:10:29.798290 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 557/1175] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:29 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:10:30.049616 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-406fe273-6dd1-4e9f-813c-c93a4deba7c2 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:30.050257 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-406fe273-6dd1-4e9f-813c-c93a4deba7c2 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:30.056847 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-406fe273-6dd1-4e9f-813c-c93a4deba7c2 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:30.057289 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-406fe273-6dd1-4e9f-813c-c93a4deba7c2 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:30.058050 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-406fe273-6dd1-4e9f-813c-c93a4deba7c2 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:30.058506 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-406fe273-6dd1-4e9f-813c-c93a4deba7c2 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:30.186901 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-406fe273-6dd1-4e9f-813c-c93a4deba7c2 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:30.194767 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-406fe273-6dd1-4e9f-813c-c93a4deba7c2 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1260 microversion: 2.1 time: 0.149782 Dec 15 13:10:30.195327 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 619/1176] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:30 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:30.815814 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-99e178c3-c0da-4d26-8ca3-c01337dddca3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:30.816419 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-99e178c3-c0da-4d26-8ca3-c01337dddca3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:30.823349 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-99e178c3-c0da-4d26-8ca3-c01337dddca3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:30.823790 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-99e178c3-c0da-4d26-8ca3-c01337dddca3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:30.824556 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-99e178c3-c0da-4d26-8ca3-c01337dddca3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:30.824984 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-99e178c3-c0da-4d26-8ca3-c01337dddca3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:30.953318 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-99e178c3-c0da-4d26-8ca3-c01337dddca3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:30.960930 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-99e178c3-c0da-4d26-8ca3-c01337dddca3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:30.962439 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-99e178c3-c0da-4d26-8ca3-c01337dddca3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:30.963582 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-99e178c3-c0da-4d26-8ca3-c01337dddca3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1722 microversion: 2.20 time: 0.151489 Dec 15 13:10:30.964125 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 558/1177] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:30 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:10:31.211096 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-071e9d11-ceac-493f-9173-460daebd510d tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:31.211698 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-071e9d11-ceac-493f-9173-460daebd510d tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:31.217899 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-071e9d11-ceac-493f-9173-460daebd510d tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:31.218387 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-071e9d11-ceac-493f-9173-460daebd510d tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:31.219151 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-071e9d11-ceac-493f-9173-460daebd510d tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:31.219575 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-071e9d11-ceac-493f-9173-460daebd510d tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:31.352483 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-071e9d11-ceac-493f-9173-460daebd510d tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:31.359690 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-071e9d11-ceac-493f-9173-460daebd510d tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1260 microversion: 2.1 time: 0.152204 Dec 15 13:10:31.360241 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 620/1178] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:31 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:31.981252 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-d0355794-717b-4e31-8a77-889399be248b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:31.981861 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-d0355794-717b-4e31-8a77-889399be248b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:31.988161 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d0355794-717b-4e31-8a77-889399be248b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:31.988606 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d0355794-717b-4e31-8a77-889399be248b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:31.990079 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d0355794-717b-4e31-8a77-889399be248b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:31.990640 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d0355794-717b-4e31-8a77-889399be248b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:32.117701 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-d0355794-717b-4e31-8a77-889399be248b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:32.125369 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-d0355794-717b-4e31-8a77-889399be248b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:32.126905 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-d0355794-717b-4e31-8a77-889399be248b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:32.128064 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-d0355794-717b-4e31-8a77-889399be248b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1722 microversion: 2.20 time: 0.150513 Dec 15 13:10:32.128610 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 559/1179] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:31 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:10:32.376841 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7496cb66-f634-49b9-8e62-e9241535aef2 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:32.377371 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7496cb66-f634-49b9-8e62-e9241535aef2 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:32.384116 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7496cb66-f634-49b9-8e62-e9241535aef2 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:32.384818 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7496cb66-f634-49b9-8e62-e9241535aef2 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:32.385582 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7496cb66-f634-49b9-8e62-e9241535aef2 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:32.386013 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7496cb66-f634-49b9-8e62-e9241535aef2 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:32.516811 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-7496cb66-f634-49b9-8e62-e9241535aef2 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:32.524094 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7496cb66-f634-49b9-8e62-e9241535aef2 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1260 microversion: 2.1 time: 0.150971 Dec 15 13:10:32.524656 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 621/1180] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:32 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:33.146431 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-426e0a63-58aa-4d97-bec6-d91b1abe3b7c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:33.147040 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-426e0a63-58aa-4d97-bec6-d91b1abe3b7c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:33.153227 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-426e0a63-58aa-4d97-bec6-d91b1abe3b7c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:33.153665 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-426e0a63-58aa-4d97-bec6-d91b1abe3b7c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:33.154471 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-426e0a63-58aa-4d97-bec6-d91b1abe3b7c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:33.154900 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-426e0a63-58aa-4d97-bec6-d91b1abe3b7c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:33.285739 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-426e0a63-58aa-4d97-bec6-d91b1abe3b7c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:33.294163 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-426e0a63-58aa-4d97-bec6-d91b1abe3b7c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:33.295689 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-426e0a63-58aa-4d97-bec6-d91b1abe3b7c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:33.297002 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-426e0a63-58aa-4d97-bec6-d91b1abe3b7c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1722 microversion: 2.20 time: 0.154377 Dec 15 13:10:33.297683 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 560/1181] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:33 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:10:33.541186 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-3f0cde98-8dd8-48c9-8a44-9c99caec9e33 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:33.541731 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-3f0cde98-8dd8-48c9-8a44-9c99caec9e33 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:33.547900 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3f0cde98-8dd8-48c9-8a44-9c99caec9e33 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:33.548345 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3f0cde98-8dd8-48c9-8a44-9c99caec9e33 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:33.549113 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3f0cde98-8dd8-48c9-8a44-9c99caec9e33 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:33.549550 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3f0cde98-8dd8-48c9-8a44-9c99caec9e33 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:33.681433 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-3f0cde98-8dd8-48c9-8a44-9c99caec9e33 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:33.688736 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-3f0cde98-8dd8-48c9-8a44-9c99caec9e33 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1260 microversion: 2.1 time: 0.151270 Dec 15 13:10:33.689286 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 622/1182] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:33 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:34.315239 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-5ccd99ed-74f6-47b7-8fe8-6883b06b5044 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:34.315841 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-5ccd99ed-74f6-47b7-8fe8-6883b06b5044 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:34.322565 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5ccd99ed-74f6-47b7-8fe8-6883b06b5044 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:34.323009 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5ccd99ed-74f6-47b7-8fe8-6883b06b5044 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:34.323777 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5ccd99ed-74f6-47b7-8fe8-6883b06b5044 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:34.324211 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5ccd99ed-74f6-47b7-8fe8-6883b06b5044 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:34.456958 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-5ccd99ed-74f6-47b7-8fe8-6883b06b5044 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:34.465090 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-5ccd99ed-74f6-47b7-8fe8-6883b06b5044 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:34.466588 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-5ccd99ed-74f6-47b7-8fe8-6883b06b5044 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:34.467736 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-5ccd99ed-74f6-47b7-8fe8-6883b06b5044 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1722 microversion: 2.20 time: 0.156253 Dec 15 13:10:34.468282 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 561/1183] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:34 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:10:34.704757 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-23b75961-2fd6-4d61-bbf7-179e90d45414 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:34.705976 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-23b75961-2fd6-4d61-bbf7-179e90d45414 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:34.712841 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-23b75961-2fd6-4d61-bbf7-179e90d45414 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:34.713291 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-23b75961-2fd6-4d61-bbf7-179e90d45414 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:34.714094 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-23b75961-2fd6-4d61-bbf7-179e90d45414 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:34.714539 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-23b75961-2fd6-4d61-bbf7-179e90d45414 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:34.846691 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-23b75961-2fd6-4d61-bbf7-179e90d45414 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:34.854762 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-23b75961-2fd6-4d61-bbf7-179e90d45414 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1260 microversion: 2.1 time: 0.153692 Dec 15 13:10:34.855317 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 623/1184] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:34 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:35.485493 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-def45497-30e1-4806-9f3c-287c5830894a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:35.486091 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-def45497-30e1-4806-9f3c-287c5830894a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:35.492878 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-def45497-30e1-4806-9f3c-287c5830894a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:35.493319 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-def45497-30e1-4806-9f3c-287c5830894a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:35.494083 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-def45497-30e1-4806-9f3c-287c5830894a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:35.494536 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-def45497-30e1-4806-9f3c-287c5830894a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:35.622535 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-def45497-30e1-4806-9f3c-287c5830894a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:35.630109 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-def45497-30e1-4806-9f3c-287c5830894a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:35.631618 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-def45497-30e1-4806-9f3c-287c5830894a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:35.632780 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-def45497-30e1-4806-9f3c-287c5830894a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1722 microversion: 2.20 time: 0.150936 Dec 15 13:10:35.633333 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 562/1185] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:35 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:10:35.871262 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6b7026f9-a44a-4bae-be80-0f48b04c759d tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:35.871883 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-6b7026f9-a44a-4bae-be80-0f48b04c759d tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:35.878210 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6b7026f9-a44a-4bae-be80-0f48b04c759d tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:35.878661 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6b7026f9-a44a-4bae-be80-0f48b04c759d tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:35.879442 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6b7026f9-a44a-4bae-be80-0f48b04c759d tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:35.879876 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6b7026f9-a44a-4bae-be80-0f48b04c759d tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:36.013008 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-6b7026f9-a44a-4bae-be80-0f48b04c759d tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:36.020146 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6b7026f9-a44a-4bae-be80-0f48b04c759d tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1260 microversion: 2.1 time: 0.152588 Dec 15 13:10:36.021209 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 624/1186] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:35 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:36.650949 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-3431a1fb-6bea-4d0a-9903-d19085c4f38e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:36.651572 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-3431a1fb-6bea-4d0a-9903-d19085c4f38e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:36.657713 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3431a1fb-6bea-4d0a-9903-d19085c4f38e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:36.658166 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3431a1fb-6bea-4d0a-9903-d19085c4f38e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:36.659007 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3431a1fb-6bea-4d0a-9903-d19085c4f38e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:36.659435 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3431a1fb-6bea-4d0a-9903-d19085c4f38e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:36.800959 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-36f7183a-0b40-48b6-ab36-847312ec116c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:36.802086 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-3431a1fb-6bea-4d0a-9903-d19085c4f38e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:36.802624 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-36f7183a-0b40-48b6-ab36-847312ec116c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:36.810573 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-3431a1fb-6bea-4d0a-9903-d19085c4f38e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:36.812080 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-3431a1fb-6bea-4d0a-9903-d19085c4f38e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:36.813227 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-3431a1fb-6bea-4d0a-9903-d19085c4f38e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1722 microversion: 2.20 time: 0.166066 Dec 15 13:10:36.813768 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 563/1187] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:36 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:10:36.818193 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-36f7183a-0b40-48b6-ab36-847312ec116c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:36.818649 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-36f7183a-0b40-48b6-ab36-847312ec116c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:36.819439 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-36f7183a-0b40-48b6-ab36-847312ec116c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:36.819874 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-36f7183a-0b40-48b6-ab36-847312ec116c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:36.852874 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-36f7183a-0b40-48b6-ab36-847312ec116c tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.055585 Dec 15 13:10:36.853426 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 625/1188] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:10:36 2021] GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/os-volume_attachments => generated 371 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:10:37.037014 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-3843abe5-c9e4-44f5-946b-31d0f6dcac39 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:37.037671 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-3843abe5-c9e4-44f5-946b-31d0f6dcac39 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:37.043438 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3843abe5-c9e4-44f5-946b-31d0f6dcac39 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:37.043887 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3843abe5-c9e4-44f5-946b-31d0f6dcac39 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:37.044691 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3843abe5-c9e4-44f5-946b-31d0f6dcac39 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:37.045127 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3843abe5-c9e4-44f5-946b-31d0f6dcac39 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:37.077443 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-3a6625a4-0240-48ea-9303-e1a92ce647a3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:37.078051 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-3a6625a4-0240-48ea-9303-e1a92ce647a3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:37.084338 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3a6625a4-0240-48ea-9303-e1a92ce647a3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:37.084783 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3a6625a4-0240-48ea-9303-e1a92ce647a3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:37.085560 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3a6625a4-0240-48ea-9303-e1a92ce647a3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:37.085981 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3a6625a4-0240-48ea-9303-e1a92ce647a3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:37.116946 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-3a6625a4-0240-48ea-9303-e1a92ce647a3 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/os-volume_attachments/8fb01cac-6b4e-4b68-ba6f-83705831deca" status: 200 len: 194 microversion: 2.1 time: 0.043261 Dec 15 13:10:37.117666 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 626/1189] 10.222.0.57 () {58 vars in 1412 bytes} [Wed Dec 15 13:10:37 2021] GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/os-volume_attachments/8fb01cac-6b4e-4b68-ba6f-83705831deca => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:10:37.127170 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7d7bcf9a-0b0f-48c4-9ead-d6cfc3458eb9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:37.127812 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7d7bcf9a-0b0f-48c4-9ead-d6cfc3458eb9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:37.134133 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7d7bcf9a-0b0f-48c4-9ead-d6cfc3458eb9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:37.134973 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7d7bcf9a-0b0f-48c4-9ead-d6cfc3458eb9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:37.136211 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7d7bcf9a-0b0f-48c4-9ead-d6cfc3458eb9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:37.136211 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7d7bcf9a-0b0f-48c4-9ead-d6cfc3458eb9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:37.186296 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-3843abe5-c9e4-44f5-946b-31d0f6dcac39 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:37.195414 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-3843abe5-c9e4-44f5-946b-31d0f6dcac39 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1260 microversion: 2.1 time: 0.162312 Dec 15 13:10:37.198632 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 564/1190] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:37 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:37.218042 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.objects.instance [None req-7d7bcf9a-0b0f-48c4-9ead-d6cfc3458eb9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lazy-loading 'services' on Instance uuid 28db6998-c25f-4217-82a4-27a03db8dff1 {{(pid=116098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:10:37.287869 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7d7bcf9a-0b0f-48c4-9ead-d6cfc3458eb9 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "DELETE /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/os-volume_attachments/8fb01cac-6b4e-4b68-ba6f-83705831deca" status: 202 len: 0 microversion: 2.1 time: 0.164061 Dec 15 13:10:37.288479 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 627/1191] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Dec 15 13:10:37 2021] DELETE /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/os-volume_attachments/8fb01cac-6b4e-4b68-ba6f-83705831deca => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:10:37.832475 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-847f1a94-dad0-4b9e-ad91-e3ed8bf500af tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:37.833144 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-847f1a94-dad0-4b9e-ad91-e3ed8bf500af tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:37.839432 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-847f1a94-dad0-4b9e-ad91-e3ed8bf500af tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:37.839875 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-847f1a94-dad0-4b9e-ad91-e3ed8bf500af tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:37.840677 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-847f1a94-dad0-4b9e-ad91-e3ed8bf500af tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:37.841107 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-847f1a94-dad0-4b9e-ad91-e3ed8bf500af tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:37.972624 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-847f1a94-dad0-4b9e-ad91-e3ed8bf500af tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:37.981467 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-847f1a94-dad0-4b9e-ad91-e3ed8bf500af tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:37.982980 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-847f1a94-dad0-4b9e-ad91-e3ed8bf500af tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:37.984125 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-847f1a94-dad0-4b9e-ad91-e3ed8bf500af tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1722 microversion: 2.20 time: 0.155430 Dec 15 13:10:37.984667 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 565/1192] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:37 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:10:38.214669 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-15393c5e-bec1-4b05-abc1-0330107e77f4 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:38.215397 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-15393c5e-bec1-4b05-abc1-0330107e77f4 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:38.221549 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-15393c5e-bec1-4b05-abc1-0330107e77f4 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:38.221991 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-15393c5e-bec1-4b05-abc1-0330107e77f4 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:38.222793 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-15393c5e-bec1-4b05-abc1-0330107e77f4 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:38.223264 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-15393c5e-bec1-4b05-abc1-0330107e77f4 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:38.358487 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-15393c5e-bec1-4b05-abc1-0330107e77f4 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:38.366422 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-15393c5e-bec1-4b05-abc1-0330107e77f4 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1260 microversion: 2.1 time: 0.156434 Dec 15 13:10:38.366998 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 628/1193] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:38 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:38.393697 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-1c1c1f6e-095b-4877-8b24-aaf8425e9ace tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:38.394220 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-1c1c1f6e-095b-4877-8b24-aaf8425e9ace tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:38.400528 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1c1c1f6e-095b-4877-8b24-aaf8425e9ace tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:38.400984 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1c1c1f6e-095b-4877-8b24-aaf8425e9ace tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:38.401765 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1c1c1f6e-095b-4877-8b24-aaf8425e9ace tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:38.402229 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1c1c1f6e-095b-4877-8b24-aaf8425e9ace tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:38.430573 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-1c1c1f6e-095b-4877-8b24-aaf8425e9ace tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/os-volume_attachments/a9ffc66f-97ff-4a71-a93a-a823dbf7ecfc" status: 200 len: 194 microversion: 2.1 time: 0.040592 Dec 15 13:10:38.431151 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 566/1194] 10.222.0.57 () {58 vars in 1412 bytes} [Wed Dec 15 13:10:38 2021] GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/os-volume_attachments/a9ffc66f-97ff-4a71-a93a-a823dbf7ecfc => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:10:38.440639 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-93d8eb8d-3dee-40b1-901b-e49e3f83b374 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:38.441129 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-93d8eb8d-3dee-40b1-901b-e49e3f83b374 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:38.446974 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-93d8eb8d-3dee-40b1-901b-e49e3f83b374 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:38.447418 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-93d8eb8d-3dee-40b1-901b-e49e3f83b374 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:38.448186 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-93d8eb8d-3dee-40b1-901b-e49e3f83b374 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:38.448616 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-93d8eb8d-3dee-40b1-901b-e49e3f83b374 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:38.526766 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.objects.instance [None req-93d8eb8d-3dee-40b1-901b-e49e3f83b374 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lazy-loading 'services' on Instance uuid 28db6998-c25f-4217-82a4-27a03db8dff1 {{(pid=116098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:10:38.603208 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-93d8eb8d-3dee-40b1-901b-e49e3f83b374 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "DELETE /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/os-volume_attachments/a9ffc66f-97ff-4a71-a93a-a823dbf7ecfc" status: 202 len: 0 microversion: 2.1 time: 0.166080 Dec 15 13:10:38.603712 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 629/1195] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Dec 15 13:10:38 2021] DELETE /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/os-volume_attachments/a9ffc66f-97ff-4a71-a93a-a823dbf7ecfc => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:10:39.002606 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-7009a492-901f-4963-a302-54341b87d590 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:39.004093 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-7009a492-901f-4963-a302-54341b87d590 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:39.010850 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7009a492-901f-4963-a302-54341b87d590 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:39.011302 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7009a492-901f-4963-a302-54341b87d590 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:39.012094 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7009a492-901f-4963-a302-54341b87d590 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:39.012528 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7009a492-901f-4963-a302-54341b87d590 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:39.106721 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-10742559-49af-4a27-8aca-fc93a6ddd13e req-257d5cb7-8a0f-462f-b5b5-5f5f52e7a1f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "619e3772-5547-4f07-b126-5b6482ad8749", "name": "network-vif-plugged", "status": "completed", "tag": "22db1fdd-c799-4ae9-bc07-611872cd4207"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:10:39.108212 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:10:39.108212 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:10:39.123431 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-10742559-49af-4a27-8aca-fc93a6ddd13e req-257d5cb7-8a0f-462f-b5b5-5f5f52e7a1f7 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:39.123621 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-10742559-49af-4a27-8aca-fc93a6ddd13e req-257d5cb7-8a0f-462f-b5b5-5f5f52e7a1f7 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:39.136649 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-10742559-49af-4a27-8aca-fc93a6ddd13e req-257d5cb7-8a0f-462f-b5b5-5f5f52e7a1f7 service nova] Creating event network-vif-plugged:22db1fdd-c799-4ae9-bc07-611872cd4207 for instance 619e3772-5547-4f07-b126-5b6482ad8749 on hv-cinder-81322 Dec 15 13:10:39.143009 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-10742559-49af-4a27-8aca-fc93a6ddd13e req-257d5cb7-8a0f-462f-b5b5-5f5f52e7a1f7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039716 Dec 15 13:10:39.144536 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 630/1196] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:10:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:10:39.167329 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-7009a492-901f-4963-a302-54341b87d590 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:39.182404 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-7009a492-901f-4963-a302-54341b87d590 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:39.184000 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-7009a492-901f-4963-a302-54341b87d590 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:39.185217 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-7009a492-901f-4963-a302-54341b87d590 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1743 microversion: 2.20 time: 0.186383 Dec 15 13:10:39.185773 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 567/1197] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:38 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1743 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:10:39.384460 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b61e0b0c-0903-4f95-a6c9-afdca0feefa3 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:39.385156 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b61e0b0c-0903-4f95-a6c9-afdca0feefa3 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:39.391713 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b61e0b0c-0903-4f95-a6c9-afdca0feefa3 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:39.392158 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b61e0b0c-0903-4f95-a6c9-afdca0feefa3 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:39.392963 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b61e0b0c-0903-4f95-a6c9-afdca0feefa3 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:39.393420 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b61e0b0c-0903-4f95-a6c9-afdca0feefa3 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:39.527444 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b61e0b0c-0903-4f95-a6c9-afdca0feefa3 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:39.534620 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b61e0b0c-0903-4f95-a6c9-afdca0feefa3 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1260 microversion: 2.1 time: 0.154941 Dec 15 13:10:39.535174 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 631/1198] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:39 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:39.753846 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-6fe2d484-2aa0-4b70-992c-9ba6465a08cc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:39.755466 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-6fe2d484-2aa0-4b70-992c-9ba6465a08cc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:39.761580 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6fe2d484-2aa0-4b70-992c-9ba6465a08cc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:39.762031 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6fe2d484-2aa0-4b70-992c-9ba6465a08cc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:39.762837 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6fe2d484-2aa0-4b70-992c-9ba6465a08cc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:39.763273 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6fe2d484-2aa0-4b70-992c-9ba6465a08cc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:39.792162 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-6fe2d484-2aa0-4b70-992c-9ba6465a08cc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041993 Dec 15 13:10:39.792717 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 568/1199] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:10:39 2021] GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:10:39.891668 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6153f2f5-5020-48b3-87a2-176b299d4084 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:39.892607 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-6153f2f5-5020-48b3-87a2-176b299d4084 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:39.898511 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6153f2f5-5020-48b3-87a2-176b299d4084 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:39.898967 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6153f2f5-5020-48b3-87a2-176b299d4084 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:39.899737 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6153f2f5-5020-48b3-87a2-176b299d4084 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:39.900174 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6153f2f5-5020-48b3-87a2-176b299d4084 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:39.928036 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6153f2f5-5020-48b3-87a2-176b299d4084 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040102 Dec 15 13:10:39.928587 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 632/1200] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Dec 15 13:10:39 2021] GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:10:39.983319 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-79e1968e-1fdb-4af5-be57-d82132480286 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:39.983857 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-79e1968e-1fdb-4af5-be57-d82132480286 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:39.990047 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-79e1968e-1fdb-4af5-be57-d82132480286 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:39.990741 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-79e1968e-1fdb-4af5-be57-d82132480286 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:39.991514 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-79e1968e-1fdb-4af5-be57-d82132480286 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:39.991948 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-79e1968e-1fdb-4af5-be57-d82132480286 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:40.017249 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-79e1968e-1fdb-4af5-be57-d82132480286 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Going to try to terminate instance {{(pid=116097) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:10:40.090100 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-79e1968e-1fdb-4af5-be57-d82132480286 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "DELETE /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1" status: 204 len: 0 microversion: 2.1 time: 0.109976 Dec 15 13:10:40.090900 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 569/1201] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Dec 15 13:10:39 2021] DELETE /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:10:40.099395 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f1e1be4c-1baa-4cec-9709-2190e3a6e5bc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:40.099994 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f1e1be4c-1baa-4cec-9709-2190e3a6e5bc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:40.105784 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f1e1be4c-1baa-4cec-9709-2190e3a6e5bc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:40.106305 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f1e1be4c-1baa-4cec-9709-2190e3a6e5bc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:40.107260 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f1e1be4c-1baa-4cec-9709-2190e3a6e5bc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:40.107694 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f1e1be4c-1baa-4cec-9709-2190e3a6e5bc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:40.203322 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-6c3bfe80-2696-4878-beaa-eecb6f78237c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:40.204017 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-6c3bfe80-2696-4878-beaa-eecb6f78237c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:40.210059 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6c3bfe80-2696-4878-beaa-eecb6f78237c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:40.211181 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6c3bfe80-2696-4878-beaa-eecb6f78237c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:40.212143 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6c3bfe80-2696-4878-beaa-eecb6f78237c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:40.213325 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6c3bfe80-2696-4878-beaa-eecb6f78237c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:40.246409 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f1e1be4c-1baa-4cec-9709-2190e3a6e5bc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:40.253812 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f1e1be4c-1baa-4cec-9709-2190e3a6e5bc tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1" status: 200 len: 1673 microversion: 2.1 time: 0.158476 Dec 15 13:10:40.258180 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 633/1202] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:40 2021] GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:10:40.345488 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-6c3bfe80-2696-4878-beaa-eecb6f78237c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:40.353679 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-6c3bfe80-2696-4878-beaa-eecb6f78237c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:40.355239 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-6c3bfe80-2696-4878-beaa-eecb6f78237c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:40.356388 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-6c3bfe80-2696-4878-beaa-eecb6f78237c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1743 microversion: 2.20 time: 0.157230 Dec 15 13:10:40.356929 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 570/1203] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:40 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:10:40.552513 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-65e2ff6b-236e-45f3-b8a6-851efafe93a8 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:40.553146 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-65e2ff6b-236e-45f3-b8a6-851efafe93a8 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:40.559419 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-65e2ff6b-236e-45f3-b8a6-851efafe93a8 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:40.559870 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-65e2ff6b-236e-45f3-b8a6-851efafe93a8 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:40.560654 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-65e2ff6b-236e-45f3-b8a6-851efafe93a8 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:40.561134 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-65e2ff6b-236e-45f3-b8a6-851efafe93a8 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:40.704050 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-65e2ff6b-236e-45f3-b8a6-851efafe93a8 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:40.712086 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-65e2ff6b-236e-45f3-b8a6-851efafe93a8 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1260 microversion: 2.1 time: 0.163665 Dec 15 13:10:40.713156 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 634/1204] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:40 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:41.271192 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-e1f10fc5-2aa6-4328-ad70-78daaf00790e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:41.271808 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-e1f10fc5-2aa6-4328-ad70-78daaf00790e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:41.278268 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e1f10fc5-2aa6-4328-ad70-78daaf00790e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:41.278957 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e1f10fc5-2aa6-4328-ad70-78daaf00790e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:41.280425 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e1f10fc5-2aa6-4328-ad70-78daaf00790e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:41.281212 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e1f10fc5-2aa6-4328-ad70-78daaf00790e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:41.375430 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1f347faf-1a00-40c0-97cb-ffc26ce14cb2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:41.376094 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1f347faf-1a00-40c0-97cb-ffc26ce14cb2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:41.384921 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1f347faf-1a00-40c0-97cb-ffc26ce14cb2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:41.389100 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1f347faf-1a00-40c0-97cb-ffc26ce14cb2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:41.390638 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1f347faf-1a00-40c0-97cb-ffc26ce14cb2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:41.390851 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1f347faf-1a00-40c0-97cb-ffc26ce14cb2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:41.477773 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-e1f10fc5-2aa6-4328-ad70-78daaf00790e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:41.487099 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-e1f10fc5-2aa6-4328-ad70-78daaf00790e tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1" status: 200 len: 1673 microversion: 2.1 time: 0.219410 Dec 15 13:10:41.488313 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 571/1205] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:41 2021] GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1 => generated 1673 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:41.561662 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1f347faf-1a00-40c0-97cb-ffc26ce14cb2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:41.570566 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1f347faf-1a00-40c0-97cb-ffc26ce14cb2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:41.572377 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1f347faf-1a00-40c0-97cb-ffc26ce14cb2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:41.573877 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1f347faf-1a00-40c0-97cb-ffc26ce14cb2 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1738 microversion: 2.20 time: 0.202300 Dec 15 13:10:41.574515 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 635/1206] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:41 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1738 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:10:41.730179 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-53798e2b-cc8a-4033-bb10-edbfdaab6ffa tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:41.730910 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-53798e2b-cc8a-4033-bb10-edbfdaab6ffa tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:41.738003 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-53798e2b-cc8a-4033-bb10-edbfdaab6ffa tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:41.738700 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-53798e2b-cc8a-4033-bb10-edbfdaab6ffa tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:41.741236 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-53798e2b-cc8a-4033-bb10-edbfdaab6ffa tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:41.741888 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-53798e2b-cc8a-4033-bb10-edbfdaab6ffa tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:41.903370 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-53798e2b-cc8a-4033-bb10-edbfdaab6ffa tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:41.911708 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-53798e2b-cc8a-4033-bb10-edbfdaab6ffa tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1441 microversion: 2.1 time: 0.185347 Dec 15 13:10:41.922386 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 572/1207] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:41 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1441 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:41.927534 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-093f9510-3530-42d3-9fd3-d6ddd75ec1ca tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:41.928576 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-093f9510-3530-42d3-9fd3-d6ddd75ec1ca tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:41.941489 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-093f9510-3530-42d3-9fd3-d6ddd75ec1ca tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:41.947261 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-093f9510-3530-42d3-9fd3-d6ddd75ec1ca tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:41.948107 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-093f9510-3530-42d3-9fd3-d6ddd75ec1ca tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:41.948543 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-093f9510-3530-42d3-9fd3-d6ddd75ec1ca tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:42.101171 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-093f9510-3530-42d3-9fd3-d6ddd75ec1ca tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:42.108859 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-093f9510-3530-42d3-9fd3-d6ddd75ec1ca tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1441 microversion: 2.1 time: 0.184895 Dec 15 13:10:42.109683 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 636/1208] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:41 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1441 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:42.511843 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-f0ed609b-81ee-4355-a5de-228fab717099 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:42.515014 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-f0ed609b-81ee-4355-a5de-228fab717099 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:42.533528 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f0ed609b-81ee-4355-a5de-228fab717099 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:42.534674 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f0ed609b-81ee-4355-a5de-228fab717099 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:42.541505 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f0ed609b-81ee-4355-a5de-228fab717099 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:42.542998 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f0ed609b-81ee-4355-a5de-228fab717099 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:42.594497 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-2bd17621-2cb9-40f3-ab4c-0cf2cab99c52 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:42.595838 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-2bd17621-2cb9-40f3-ab4c-0cf2cab99c52 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:42.611027 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2bd17621-2cb9-40f3-ab4c-0cf2cab99c52 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:42.614729 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2bd17621-2cb9-40f3-ab4c-0cf2cab99c52 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:42.618597 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2bd17621-2cb9-40f3-ab4c-0cf2cab99c52 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:42.620124 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2bd17621-2cb9-40f3-ab4c-0cf2cab99c52 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:42.829030 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-f0ed609b-81ee-4355-a5de-228fab717099 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:42.839317 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-f0ed609b-81ee-4355-a5de-228fab717099 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1" status: 200 len: 1673 microversion: 2.1 time: 0.338362 Dec 15 13:10:42.840243 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 573/1209] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:42 2021] GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1 => generated 1673 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:42.865482 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-2bd17621-2cb9-40f3-ab4c-0cf2cab99c52 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:42.885094 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-2bd17621-2cb9-40f3-ab4c-0cf2cab99c52 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:42.889928 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-2bd17621-2cb9-40f3-ab4c-0cf2cab99c52 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:42.891507 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-2bd17621-2cb9-40f3-ab4c-0cf2cab99c52 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1738 microversion: 2.20 time: 0.302593 Dec 15 13:10:42.906845 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 637/1210] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:42 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1738 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:10:43.237270 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-7bb3cd7d-93df-41e7-9695-4e0d22de1f70 req-25a14ace-283d-484b-a7ad-e642faf7d5d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5328000e-dd8e-4bff-b035-2114c746691a", "name": "network-vif-plugged", "status": "completed", "tag": "78004f41-fe9a-4327-8c94-953fab674338"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:10:43.241950 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:10:43.241950 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:10:43.266105 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-7bb3cd7d-93df-41e7-9695-4e0d22de1f70 req-25a14ace-283d-484b-a7ad-e642faf7d5d7 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:43.269687 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-7bb3cd7d-93df-41e7-9695-4e0d22de1f70 req-25a14ace-283d-484b-a7ad-e642faf7d5d7 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:43.299047 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-7bb3cd7d-93df-41e7-9695-4e0d22de1f70 req-25a14ace-283d-484b-a7ad-e642faf7d5d7 service nova] Creating event network-vif-plugged:78004f41-fe9a-4327-8c94-953fab674338 for instance 5328000e-dd8e-4bff-b035-2114c746691a on hv-cinder-81322 Dec 15 13:10:43.312694 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-7bb3cd7d-93df-41e7-9695-4e0d22de1f70 req-25a14ace-283d-484b-a7ad-e642faf7d5d7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080477 Dec 15 13:10:43.315895 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 574/1211] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:10:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:10:43.653358 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-624e2094-f3de-4e26-ad92-a6023a9153f2 req-788ce4b0-7a72-4707-8f66-008f75c48208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28db6998-c25f-4217-82a4-27a03db8dff1", "name": "network-vif-deleted", "tag": "4d6169ab-848d-4edd-8099-1fe5303738ce"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:10:43.655216 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:10:43.655216 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:10:43.663725 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-624e2094-f3de-4e26-ad92-a6023a9153f2 req-788ce4b0-7a72-4707-8f66-008f75c48208 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:43.664164 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-624e2094-f3de-4e26-ad92-a6023a9153f2 req-788ce4b0-7a72-4707-8f66-008f75c48208 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:43.688937 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-624e2094-f3de-4e26-ad92-a6023a9153f2 req-788ce4b0-7a72-4707-8f66-008f75c48208 service nova] Creating event network-vif-deleted:4d6169ab-848d-4edd-8099-1fe5303738ce for instance 28db6998-c25f-4217-82a4-27a03db8dff1 on hv-cinder-81322 Dec 15 13:10:43.698283 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-624e2094-f3de-4e26-ad92-a6023a9153f2 req-788ce4b0-7a72-4707-8f66-008f75c48208 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049656 Dec 15 13:10:43.702099 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 638/1212] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:10:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:10:43.857568 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-6a44eb55-efec-4c14-b369-08d3d4e6275a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:43.858483 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-6a44eb55-efec-4c14-b369-08d3d4e6275a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:43.870422 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6a44eb55-efec-4c14-b369-08d3d4e6275a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:43.871292 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6a44eb55-efec-4c14-b369-08d3d4e6275a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:43.874323 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6a44eb55-efec-4c14-b369-08d3d4e6275a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:43.874796 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6a44eb55-efec-4c14-b369-08d3d4e6275a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:43.913561 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d910db58-c9b7-47c8-81ac-1d83c5ab5b93 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:43.914415 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d910db58-c9b7-47c8-81ac-1d83c5ab5b93 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:43.922590 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d910db58-c9b7-47c8-81ac-1d83c5ab5b93 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:43.927604 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d910db58-c9b7-47c8-81ac-1d83c5ab5b93 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:43.928810 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d910db58-c9b7-47c8-81ac-1d83c5ab5b93 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:43.929415 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d910db58-c9b7-47c8-81ac-1d83c5ab5b93 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:43.932742 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6a44eb55-efec-4c14-b369-08d3d4e6275a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:43.933436 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6a44eb55-efec-4c14-b369-08d3d4e6275a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:43.933906 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.objects.instance [None req-6a44eb55-efec-4c14-b369-08d3d4e6275a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lazy-loading 'fault' on Instance uuid 28db6998-c25f-4217-82a4-27a03db8dff1 {{(pid=116097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:10:44.007051 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-6a44eb55-efec-4c14-b369-08d3d4e6275a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7f1cc9a2214907871542822081375f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0255d615a14a41af48a7a999a42469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:44.016092 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-6a44eb55-efec-4c14-b369-08d3d4e6275a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1" status: 200 len: 1326 microversion: 2.1 time: 0.162206 Dec 15 13:10:44.025752 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 575/1213] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:43 2021] GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1 => generated 1326 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:44.140745 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d910db58-c9b7-47c8-81ac-1d83c5ab5b93 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:44.162119 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d910db58-c9b7-47c8-81ac-1d83c5ab5b93 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:44.163685 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d910db58-c9b7-47c8-81ac-1d83c5ab5b93 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:44.164915 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d910db58-c9b7-47c8-81ac-1d83c5ab5b93 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1738 microversion: 2.20 time: 0.255844 Dec 15 13:10:44.167371 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 639/1214] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:43 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1738 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:10:44.904665 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-d0d3ebba-8fe7-480c-be67-3e84fa190342 req-6c671b08-a3fb-4255-944a-2c63f4d19471 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "619e3772-5547-4f07-b126-5b6482ad8749", "tag": "22db1fdd-c799-4ae9-bc07-611872cd4207"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:10:44.906272 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:10:44.906272 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:10:44.913746 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-d0d3ebba-8fe7-480c-be67-3e84fa190342 req-6c671b08-a3fb-4255-944a-2c63f4d19471 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:44.914246 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-d0d3ebba-8fe7-480c-be67-3e84fa190342 req-6c671b08-a3fb-4255-944a-2c63f4d19471 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:44.927594 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-d0d3ebba-8fe7-480c-be67-3e84fa190342 req-6c671b08-a3fb-4255-944a-2c63f4d19471 service nova] Creating event network-changed:22db1fdd-c799-4ae9-bc07-611872cd4207 for instance 619e3772-5547-4f07-b126-5b6482ad8749 on hv-cinder-81322 Dec 15 13:10:44.932711 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-d0d3ebba-8fe7-480c-be67-3e84fa190342 req-6c671b08-a3fb-4255-944a-2c63f4d19471 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036248 Dec 15 13:10:44.933373 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 576/1215] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:10:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:10:45.033633 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c7dc7837-6cbe-4b34-ae1d-47c3caac1e3a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:45.034274 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c7dc7837-6cbe-4b34-ae1d-47c3caac1e3a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:45.047061 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c7dc7837-6cbe-4b34-ae1d-47c3caac1e3a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:45.048034 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c7dc7837-6cbe-4b34-ae1d-47c3caac1e3a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:45.049022 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c7dc7837-6cbe-4b34-ae1d-47c3caac1e3a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:45.049619 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c7dc7837-6cbe-4b34-ae1d-47c3caac1e3a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:45.073392 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-c7dc7837-6cbe-4b34-ae1d-47c3caac1e3a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] HTTP exception thrown: Instance 28db6998-c25f-4217-82a4-27a03db8dff1 could not be found. Dec 15 13:10:45.075011 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c7dc7837-6cbe-4b34-ae1d-47c3caac1e3a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Returning 404 to user: Instance 28db6998-c25f-4217-82a4-27a03db8dff1 could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:10:45.082673 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c7dc7837-6cbe-4b34-ae1d-47c3caac1e3a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1" status: 404 len: 111 microversion: 2.1 time: 0.053394 Dec 15 13:10:45.084552 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 640/1216] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:45 2021] GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:10:45.092806 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-3c33c76c-300e-4b00-8388-1ef29d047446 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '.version_select at 0x7faf18113f70>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:45.133798 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-3c33c76c-300e-4b00-8388-1ef29d047446 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-503347203" status: 202 len: 0 microversion: 2.1 time: 0.045304 Dec 15 13:10:45.139448 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 577/1217] 10.222.0.57 () {58 vars in 1217 bytes} [Wed Dec 15 13:10:45 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-503347203 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:10:45.184126 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-41c5a14d-2b02-426b-b134-d3bee77094b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:45.185525 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-41c5a14d-2b02-426b-b134-d3bee77094b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:45.194746 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-41c5a14d-2b02-426b-b134-d3bee77094b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:45.201009 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-41c5a14d-2b02-426b-b134-d3bee77094b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:45.202301 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-41c5a14d-2b02-426b-b134-d3bee77094b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:45.203727 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-41c5a14d-2b02-426b-b134-d3bee77094b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:45.619901 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-41c5a14d-2b02-426b-b134-d3bee77094b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:45.627890 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-41c5a14d-2b02-426b-b134-d3bee77094b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:45.640181 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-41c5a14d-2b02-426b-b134-d3bee77094b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:45.641604 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-41c5a14d-2b02-426b-b134-d3bee77094b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1738 microversion: 2.20 time: 0.462022 Dec 15 13:10:45.652559 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 641/1218] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:45 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1738 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:10:46.660086 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-4ba91bcd-2efd-4e4c-8993-34962293b44a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:46.661486 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-4ba91bcd-2efd-4e4c-8993-34962293b44a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:46.672465 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4ba91bcd-2efd-4e4c-8993-34962293b44a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:46.673245 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4ba91bcd-2efd-4e4c-8993-34962293b44a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:46.674282 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4ba91bcd-2efd-4e4c-8993-34962293b44a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:46.674727 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4ba91bcd-2efd-4e4c-8993-34962293b44a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:46.845224 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-4ba91bcd-2efd-4e4c-8993-34962293b44a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:46.853861 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-4ba91bcd-2efd-4e4c-8993-34962293b44a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:46.855462 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-4ba91bcd-2efd-4e4c-8993-34962293b44a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:46.856620 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-4ba91bcd-2efd-4e4c-8993-34962293b44a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1738 microversion: 2.20 time: 0.200325 Dec 15 13:10:46.857164 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 578/1219] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:46 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1738 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:10:47.875785 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1fc4d313-81c6-4046-b6da-2a2536f8abcc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:47.876440 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1fc4d313-81c6-4046-b6da-2a2536f8abcc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:47.883885 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1fc4d313-81c6-4046-b6da-2a2536f8abcc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:47.884589 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1fc4d313-81c6-4046-b6da-2a2536f8abcc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:47.885406 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1fc4d313-81c6-4046-b6da-2a2536f8abcc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:47.885844 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1fc4d313-81c6-4046-b6da-2a2536f8abcc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:48.054044 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1fc4d313-81c6-4046-b6da-2a2536f8abcc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:48.064388 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1fc4d313-81c6-4046-b6da-2a2536f8abcc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:48.066000 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1fc4d313-81c6-4046-b6da-2a2536f8abcc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:48.068204 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1fc4d313-81c6-4046-b6da-2a2536f8abcc tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1738 microversion: 2.20 time: 0.196438 Dec 15 13:10:48.069029 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 642/1220] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:47 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:10:48.597274 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-d5bb9fbb-e9b5-4f41-8625-34dab5aa27e2 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:48.598882 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-d5bb9fbb-e9b5-4f41-8625-34dab5aa27e2 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:48.605359 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d5bb9fbb-e9b5-4f41-8625-34dab5aa27e2 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:48.605806 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d5bb9fbb-e9b5-4f41-8625-34dab5aa27e2 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:48.606609 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d5bb9fbb-e9b5-4f41-8625-34dab5aa27e2 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:48.607207 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d5bb9fbb-e9b5-4f41-8625-34dab5aa27e2 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:48.621717 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.wsgi [None req-d5bb9fbb-e9b5-4f41-8625-34dab5aa27e2 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] HTTP exception thrown: Instance 28db6998-c25f-4217-82a4-27a03db8dff1 could not be found. Dec 15 13:10:48.622623 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-d5bb9fbb-e9b5-4f41-8625-34dab5aa27e2 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Returning 404 to user: Instance 28db6998-c25f-4217-82a4-27a03db8dff1 could not be found. {{(pid=116097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:10:48.623632 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-d5bb9fbb-e9b5-4f41-8625-34dab5aa27e2 tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "DELETE /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1" status: 404 len: 111 microversion: 2.1 time: 0.030045 Dec 15 13:10:48.624162 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 579/1221] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Dec 15 13:10:48 2021] DELETE /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:10:48.632599 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-226f83e5-8086-4631-a4d1-1c855ec1fb3d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:48.633317 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-226f83e5-8086-4631-a4d1-1c855ec1fb3d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 28db6998-c25f-4217-82a4-27a03db8dff1] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:48.639582 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-226f83e5-8086-4631-a4d1-1c855ec1fb3d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:48.640302 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-226f83e5-8086-4631-a4d1-1c855ec1fb3d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:48.641170 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-226f83e5-8086-4631-a4d1-1c855ec1fb3d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:48.641673 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-226f83e5-8086-4631-a4d1-1c855ec1fb3d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:48.658236 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-226f83e5-8086-4631-a4d1-1c855ec1fb3d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] HTTP exception thrown: Instance 28db6998-c25f-4217-82a4-27a03db8dff1 could not be found. Dec 15 13:10:48.659109 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-226f83e5-8086-4631-a4d1-1c855ec1fb3d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Returning 404 to user: Instance 28db6998-c25f-4217-82a4-27a03db8dff1 could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:10:48.660689 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-226f83e5-8086-4631-a4d1-1c855ec1fb3d tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1" status: 404 len: 111 microversion: 2.1 time: 0.031939 Dec 15 13:10:48.661235 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 643/1222] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:48 2021] GET /compute/v2.1/servers/28db6998-c25f-4217-82a4-27a03db8dff1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:10:49.092701 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-3d2c9217-9129-43af-afe8-3882910b464e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:49.094002 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-3d2c9217-9129-43af-afe8-3882910b464e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:49.102016 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3d2c9217-9129-43af-afe8-3882910b464e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:49.102479 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3d2c9217-9129-43af-afe8-3882910b464e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:49.103276 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3d2c9217-9129-43af-afe8-3882910b464e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:49.103721 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3d2c9217-9129-43af-afe8-3882910b464e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:49.253583 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-3d2c9217-9129-43af-afe8-3882910b464e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:49.264599 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-3d2c9217-9129-43af-afe8-3882910b464e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:49.266178 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-3d2c9217-9129-43af-afe8-3882910b464e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:49.267430 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-3d2c9217-9129-43af-afe8-3882910b464e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1738 microversion: 2.20 time: 0.184871 Dec 15 13:10:49.270634 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 580/1223] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:49 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:10:49.812823 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-55d03880-5998-49f2-9f20-e5957e8bdd0a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:49.814446 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-55d03880-5998-49f2-9f20-e5957e8bdd0a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:49.824459 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-55d03880-5998-49f2-9f20-e5957e8bdd0a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:49.826094 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-55d03880-5998-49f2-9f20-e5957e8bdd0a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:49.827117 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-55d03880-5998-49f2-9f20-e5957e8bdd0a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:49.827725 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-55d03880-5998-49f2-9f20-e5957e8bdd0a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:49.850059 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-55d03880-5998-49f2-9f20-e5957e8bdd0a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] HTTP exception thrown: Instance 8d29665f-f416-4d8b-8a0a-7e1eb1515440 could not be found. Dec 15 13:10:49.850975 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-55d03880-5998-49f2-9f20-e5957e8bdd0a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Returning 404 to user: Instance 8d29665f-f416-4d8b-8a0a-7e1eb1515440 could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:10:49.851996 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-55d03880-5998-49f2-9f20-e5957e8bdd0a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 404 len: 111 microversion: 2.1 time: 0.043197 Dec 15 13:10:49.855874 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 644/1224] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Dec 15 13:10:49 2021] DELETE /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:10:49.860656 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-8f71021f-f807-4ce9-be48-9e26bdbbfb7a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:49.861317 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-8f71021f-f807-4ce9-be48-9e26bdbbfb7a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] [instance: 8d29665f-f416-4d8b-8a0a-7e1eb1515440] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:49.868947 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8f71021f-f807-4ce9-be48-9e26bdbbfb7a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:49.869698 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8f71021f-f807-4ce9-be48-9e26bdbbfb7a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:49.870641 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8f71021f-f807-4ce9-be48-9e26bdbbfb7a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:49.871298 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8f71021f-f807-4ce9-be48-9e26bdbbfb7a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:49.886250 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.wsgi [None req-8f71021f-f807-4ce9-be48-9e26bdbbfb7a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] HTTP exception thrown: Instance 8d29665f-f416-4d8b-8a0a-7e1eb1515440 could not be found. Dec 15 13:10:49.887225 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-8f71021f-f807-4ce9-be48-9e26bdbbfb7a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] Returning 404 to user: Instance 8d29665f-f416-4d8b-8a0a-7e1eb1515440 could not be found. {{(pid=116097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:10:49.888279 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-8f71021f-f807-4ce9-be48-9e26bdbbfb7a tempest-AttachVolumeTestJSON-1991994330 tempest-AttachVolumeTestJSON-1991994330-project] 10.222.0.57 "GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440" status: 404 len: 111 microversion: 2.1 time: 0.031506 Dec 15 13:10:49.889317 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 581/1225] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:49 2021] GET /compute/v2.1/servers/8d29665f-f416-4d8b-8a0a-7e1eb1515440 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 13:10:50.286069 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a792ffff-84af-4452-8ff3-9f8f095ab0c3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:50.287094 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a792ffff-84af-4452-8ff3-9f8f095ab0c3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:50.296261 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a792ffff-84af-4452-8ff3-9f8f095ab0c3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:50.297171 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a792ffff-84af-4452-8ff3-9f8f095ab0c3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:50.303870 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a792ffff-84af-4452-8ff3-9f8f095ab0c3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:50.304384 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a792ffff-84af-4452-8ff3-9f8f095ab0c3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:50.512581 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a792ffff-84af-4452-8ff3-9f8f095ab0c3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:50.521973 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a792ffff-84af-4452-8ff3-9f8f095ab0c3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:50.523620 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a792ffff-84af-4452-8ff3-9f8f095ab0c3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:50.524853 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a792ffff-84af-4452-8ff3-9f8f095ab0c3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1738 microversion: 2.20 time: 0.242857 Dec 15 13:10:50.525691 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 645/1226] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:50 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1738 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:10:51.543831 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-74d3169d-3a1b-4924-9992-1c7939be2777 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:51.544438 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-74d3169d-3a1b-4924-9992-1c7939be2777 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:51.551144 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-74d3169d-3a1b-4924-9992-1c7939be2777 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:51.551144 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-74d3169d-3a1b-4924-9992-1c7939be2777 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:51.551882 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-74d3169d-3a1b-4924-9992-1c7939be2777 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:51.552326 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-74d3169d-3a1b-4924-9992-1c7939be2777 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:51.686727 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-74d3169d-3a1b-4924-9992-1c7939be2777 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:51.695731 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-74d3169d-3a1b-4924-9992-1c7939be2777 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:51.697222 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-74d3169d-3a1b-4924-9992-1c7939be2777 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:51.698428 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-74d3169d-3a1b-4924-9992-1c7939be2777 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1738 microversion: 2.20 time: 0.158508 Dec 15 13:10:51.699013 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 582/1227] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:51 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:10:52.720861 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5e394dc9-6563-4870-a454-ae25da1c67e3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:52.721456 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5e394dc9-6563-4870-a454-ae25da1c67e3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:52.728822 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5e394dc9-6563-4870-a454-ae25da1c67e3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:52.729261 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5e394dc9-6563-4870-a454-ae25da1c67e3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:52.730043 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5e394dc9-6563-4870-a454-ae25da1c67e3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:52.730497 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5e394dc9-6563-4870-a454-ae25da1c67e3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:52.909280 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5e394dc9-6563-4870-a454-ae25da1c67e3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:52.918370 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5e394dc9-6563-4870-a454-ae25da1c67e3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:52.919963 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5e394dc9-6563-4870-a454-ae25da1c67e3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:52.921185 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5e394dc9-6563-4870-a454-ae25da1c67e3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1720 microversion: 2.20 time: 0.204233 Dec 15 13:10:52.921830 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 646/1228] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:52 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1720 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:10:53.940349 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-50ba71a5-7850-4012-b708-12d899549e15 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:53.940956 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-50ba71a5-7850-4012-b708-12d899549e15 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:53.947271 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-50ba71a5-7850-4012-b708-12d899549e15 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:53.947725 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-50ba71a5-7850-4012-b708-12d899549e15 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:53.948541 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-50ba71a5-7850-4012-b708-12d899549e15 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:53.948978 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-50ba71a5-7850-4012-b708-12d899549e15 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:54.094582 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-50ba71a5-7850-4012-b708-12d899549e15 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:54.104695 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-50ba71a5-7850-4012-b708-12d899549e15 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:54.107097 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-50ba71a5-7850-4012-b708-12d899549e15 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:54.109371 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-50ba71a5-7850-4012-b708-12d899549e15 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1720 microversion: 2.20 time: 0.172748 Dec 15 13:10:54.110211 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 583/1229] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:53 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:10:55.128595 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-754a3bf8-9e6b-42af-bfff-d6382c4b9202 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:55.129708 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-754a3bf8-9e6b-42af-bfff-d6382c4b9202 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:55.137036 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-754a3bf8-9e6b-42af-bfff-d6382c4b9202 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:55.137559 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-754a3bf8-9e6b-42af-bfff-d6382c4b9202 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:55.138437 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-754a3bf8-9e6b-42af-bfff-d6382c4b9202 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:55.139187 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-754a3bf8-9e6b-42af-bfff-d6382c4b9202 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:55.155296 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-9a660c93-7b96-4e84-894d-c8c53f372bf3 req-3fdd3041-2f6b-4f3c-b12c-49a513037e44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5328000e-dd8e-4bff-b035-2114c746691a", "name": "network-vif-unplugged", "status": "completed", "tag": "78004f41-fe9a-4327-8c94-953fab674338"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:10:55.157847 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:10:55.157847 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:10:55.167648 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-9a660c93-7b96-4e84-894d-c8c53f372bf3 req-3fdd3041-2f6b-4f3c-b12c-49a513037e44 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:55.168091 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-9a660c93-7b96-4e84-894d-c8c53f372bf3 req-3fdd3041-2f6b-4f3c-b12c-49a513037e44 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:55.180543 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.compute.server_external_events [req-9a660c93-7b96-4e84-894d-c8c53f372bf3 req-3fdd3041-2f6b-4f3c-b12c-49a513037e44 service nova] Unable to find a host for instance 5328000e-dd8e-4bff-b035-2114c746691a. Dropping event network-vif-unplugged {{(pid=116097) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 15 13:10:55.181400 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-9a660c93-7b96-4e84-894d-c8c53f372bf3 req-3fdd3041-2f6b-4f3c-b12c-49a513037e44 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.038939 Dec 15 13:10:55.182386 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 584/1230] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:10:55 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Dec 15 13:10:55.288113 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-754a3bf8-9e6b-42af-bfff-d6382c4b9202 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:55.296537 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-754a3bf8-9e6b-42af-bfff-d6382c4b9202 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:55.298184 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-754a3bf8-9e6b-42af-bfff-d6382c4b9202 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:55.299690 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-754a3bf8-9e6b-42af-bfff-d6382c4b9202 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1663 microversion: 2.20 time: 0.174650 Dec 15 13:10:55.309412 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 647/1231] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:55 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1663 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:10:55.318328 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-46080c14-3693-4ca0-a063-807c86fd7cd1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89e89463-1471-49bb-bd9a-fa284effdcf4"}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:10:55.319394 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-46080c14-3693-4ca0-a063-807c86fd7cd1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:55.325538 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-46080c14-3693-4ca0-a063-807c86fd7cd1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:55.325996 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-46080c14-3693-4ca0-a063-807c86fd7cd1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:55.326825 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-46080c14-3693-4ca0-a063-807c86fd7cd1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:55.327270 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-46080c14-3693-4ca0-a063-807c86fd7cd1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:55.605796 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-46080c14-3693-4ca0-a063-807c86fd7cd1 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.291006 Dec 15 13:10:55.606832 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 585/1232] 10.222.0.57 () {62 vars in 1363 bytes} [Wed Dec 15 13:10:55 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/os-volume_attachments => generated 188 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:10:55.736106 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6957f4f5-4ae7-4841-8a68-9e0c03f31dbf tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:55.736604 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-6957f4f5-4ae7-4841-8a68-9e0c03f31dbf tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:55.742934 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6957f4f5-4ae7-4841-8a68-9e0c03f31dbf tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:55.743387 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6957f4f5-4ae7-4841-8a68-9e0c03f31dbf tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:55.744181 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6957f4f5-4ae7-4841-8a68-9e0c03f31dbf tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:55.744610 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6957f4f5-4ae7-4841-8a68-9e0c03f31dbf tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:55.984156 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6957f4f5-4ae7-4841-8a68-9e0c03f31dbf tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/os-volume_attachments/89e89463-1471-49bb-bd9a-fa284effdcf4" status: 202 len: 0 microversion: 2.20 time: 0.251724 Dec 15 13:10:55.984837 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 648/1233] 10.222.0.57 () {60 vars in 1456 bytes} [Wed Dec 15 13:10:55 2021] DELETE /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/os-volume_attachments/89e89463-1471-49bb-bd9a-fa284effdcf4 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:10:56.039976 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-3836650f-b82d-4a25-bf8b-561dafa14849 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:10:56.040555 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-3836650f-b82d-4a25-bf8b-561dafa14849 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:56.046885 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3836650f-b82d-4a25-bf8b-561dafa14849 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:56.047331 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3836650f-b82d-4a25-bf8b-561dafa14849 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:56.048114 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3836650f-b82d-4a25-bf8b-561dafa14849 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:56.048549 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3836650f-b82d-4a25-bf8b-561dafa14849 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:56.149050 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-3836650f-b82d-4a25-bf8b-561dafa14849 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action" status: 202 len: 0 microversion: 2.20 time: 0.112596 Dec 15 13:10:56.149860 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 586/1234] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Dec 15 13:10:56 2021] POST /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:10:56.158164 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5fe49a4b-3f1e-4f01-9c43-f2ea155e1263 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:56.158881 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5fe49a4b-3f1e-4f01-9c43-f2ea155e1263 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:56.166674 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5fe49a4b-3f1e-4f01-9c43-f2ea155e1263 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:56.167454 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5fe49a4b-3f1e-4f01-9c43-f2ea155e1263 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:56.168356 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5fe49a4b-3f1e-4f01-9c43-f2ea155e1263 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:56.168894 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5fe49a4b-3f1e-4f01-9c43-f2ea155e1263 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:56.372128 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5fe49a4b-3f1e-4f01-9c43-f2ea155e1263 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:56.381360 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5fe49a4b-3f1e-4f01-9c43-f2ea155e1263 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:56.383077 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5fe49a4b-3f1e-4f01-9c43-f2ea155e1263 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:56.384717 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5fe49a4b-3f1e-4f01-9c43-f2ea155e1263 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1671 microversion: 2.20 time: 0.230101 Dec 15 13:10:56.385870 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 649/1235] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:56 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1671 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:10:57.404311 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-d3ea17f3-981a-4c09-a874-17478b3d71b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:57.405815 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-d3ea17f3-981a-4c09-a874-17478b3d71b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:57.414569 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d3ea17f3-981a-4c09-a874-17478b3d71b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:57.415056 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d3ea17f3-981a-4c09-a874-17478b3d71b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:57.415906 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d3ea17f3-981a-4c09-a874-17478b3d71b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:57.416206 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d3ea17f3-981a-4c09-a874-17478b3d71b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:57.563082 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-d3ea17f3-981a-4c09-a874-17478b3d71b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:57.571304 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-d3ea17f3-981a-4c09-a874-17478b3d71b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:57.572785 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-d3ea17f3-981a-4c09-a874-17478b3d71b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:57.573951 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-d3ea17f3-981a-4c09-a874-17478b3d71b7 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1729 microversion: 2.20 time: 0.173540 Dec 15 13:10:57.578573 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 587/1236] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:57 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:10:58.592504 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0202c378-1430-4751-9411-80aad747adcf tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:58.593190 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0202c378-1430-4751-9411-80aad747adcf tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:58.600252 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0202c378-1430-4751-9411-80aad747adcf tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:58.600703 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0202c378-1430-4751-9411-80aad747adcf tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:58.601500 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0202c378-1430-4751-9411-80aad747adcf tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:58.601938 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0202c378-1430-4751-9411-80aad747adcf tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:58.765277 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0202c378-1430-4751-9411-80aad747adcf tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:58.773741 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0202c378-1430-4751-9411-80aad747adcf tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:58.775275 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0202c378-1430-4751-9411-80aad747adcf tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:58.776669 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-0202c378-1430-4751-9411-80aad747adcf tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1729 microversion: 2.20 time: 0.187834 Dec 15 13:10:58.777402 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 650/1237] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:58 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:10:59.795414 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-ee3a2c44-f654-455c-a8c9-1aa313e40a32 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:59.796737 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-ee3a2c44-f654-455c-a8c9-1aa313e40a32 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:59.815076 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ee3a2c44-f654-455c-a8c9-1aa313e40a32 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:59.815364 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ee3a2c44-f654-455c-a8c9-1aa313e40a32 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:59.816298 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ee3a2c44-f654-455c-a8c9-1aa313e40a32 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:59.816736 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ee3a2c44-f654-455c-a8c9-1aa313e40a32 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:59.993660 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-ee3a2c44-f654-455c-a8c9-1aa313e40a32 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:00.005011 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-ee3a2c44-f654-455c-a8c9-1aa313e40a32 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:00.007289 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-ee3a2c44-f654-455c-a8c9-1aa313e40a32 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:00.009206 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-ee3a2c44-f654-455c-a8c9-1aa313e40a32 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1729 microversion: 2.20 time: 0.217481 Dec 15 13:11:00.010019 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 588/1238] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:10:59 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1729 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:11:01.028837 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-be08811b-9aa3-4167-b73c-bb63175722ab tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:01.029537 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-be08811b-9aa3-4167-b73c-bb63175722ab tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:01.036724 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be08811b-9aa3-4167-b73c-bb63175722ab tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:01.037400 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be08811b-9aa3-4167-b73c-bb63175722ab tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:01.038538 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be08811b-9aa3-4167-b73c-bb63175722ab tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:01.039130 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be08811b-9aa3-4167-b73c-bb63175722ab tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:01.215840 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-be08811b-9aa3-4167-b73c-bb63175722ab tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:01.226312 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-be08811b-9aa3-4167-b73c-bb63175722ab tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:01.228118 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-be08811b-9aa3-4167-b73c-bb63175722ab tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:01.229480 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-be08811b-9aa3-4167-b73c-bb63175722ab tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1729 microversion: 2.20 time: 0.204427 Dec 15 13:11:01.243441 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 651/1239] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:11:01 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1729 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:11:02.255968 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-0ed3c90e-c4a5-46eb-86eb-4e5d8aa82e89 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:02.257652 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-0ed3c90e-c4a5-46eb-86eb-4e5d8aa82e89 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:02.265193 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0ed3c90e-c4a5-46eb-86eb-4e5d8aa82e89 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:02.266191 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0ed3c90e-c4a5-46eb-86eb-4e5d8aa82e89 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:02.267284 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0ed3c90e-c4a5-46eb-86eb-4e5d8aa82e89 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:02.267815 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-0ed3c90e-c4a5-46eb-86eb-4e5d8aa82e89 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:02.413436 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-0ed3c90e-c4a5-46eb-86eb-4e5d8aa82e89 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:02.421314 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-0ed3c90e-c4a5-46eb-86eb-4e5d8aa82e89 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:02.422883 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-0ed3c90e-c4a5-46eb-86eb-4e5d8aa82e89 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:02.424387 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-0ed3c90e-c4a5-46eb-86eb-4e5d8aa82e89 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1729 microversion: 2.20 time: 0.174838 Dec 15 13:11:02.425477 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 589/1240] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:11:02 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:11:03.444005 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-be1953f3-8f70-4d89-9fab-13ed4111633a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:03.444621 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-be1953f3-8f70-4d89-9fab-13ed4111633a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:03.450665 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be1953f3-8f70-4d89-9fab-13ed4111633a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:03.451325 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be1953f3-8f70-4d89-9fab-13ed4111633a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:03.452266 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be1953f3-8f70-4d89-9fab-13ed4111633a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:03.452792 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be1953f3-8f70-4d89-9fab-13ed4111633a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:03.605188 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-be1953f3-8f70-4d89-9fab-13ed4111633a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:03.615190 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-be1953f3-8f70-4d89-9fab-13ed4111633a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:03.616791 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-be1953f3-8f70-4d89-9fab-13ed4111633a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:03.618007 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-be1953f3-8f70-4d89-9fab-13ed4111633a tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1729 microversion: 2.20 time: 0.178732 Dec 15 13:11:03.618759 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 652/1241] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:11:03 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:11:04.636517 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-b1c46b69-998f-4cdc-8e99-f4f0b491a940 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:04.637758 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-b1c46b69-998f-4cdc-8e99-f4f0b491a940 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:04.645167 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b1c46b69-998f-4cdc-8e99-f4f0b491a940 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:04.645793 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b1c46b69-998f-4cdc-8e99-f4f0b491a940 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:04.646784 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b1c46b69-998f-4cdc-8e99-f4f0b491a940 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:04.647996 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b1c46b69-998f-4cdc-8e99-f4f0b491a940 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:04.826770 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-b1c46b69-998f-4cdc-8e99-f4f0b491a940 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:04.834914 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-b1c46b69-998f-4cdc-8e99-f4f0b491a940 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:04.836679 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-b1c46b69-998f-4cdc-8e99-f4f0b491a940 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:04.837846 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-b1c46b69-998f-4cdc-8e99-f4f0b491a940 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1729 microversion: 2.20 time: 0.205362 Dec 15 13:11:04.838427 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 590/1242] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:11:04 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1729 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:11:05.856495 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-85d8cd09-15c8-4a39-b961-a50af863e438 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:05.857211 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-85d8cd09-15c8-4a39-b961-a50af863e438 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:05.864420 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-85d8cd09-15c8-4a39-b961-a50af863e438 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:05.864876 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-85d8cd09-15c8-4a39-b961-a50af863e438 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:05.865663 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-85d8cd09-15c8-4a39-b961-a50af863e438 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:05.866102 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-85d8cd09-15c8-4a39-b961-a50af863e438 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:06.069759 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-85d8cd09-15c8-4a39-b961-a50af863e438 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:06.079784 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-85d8cd09-15c8-4a39-b961-a50af863e438 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:06.091343 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-85d8cd09-15c8-4a39-b961-a50af863e438 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:06.092753 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-85d8cd09-15c8-4a39-b961-a50af863e438 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1729 microversion: 2.20 time: 0.240069 Dec 15 13:11:06.093633 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 653/1243] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:11:05 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1729 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:11:07.113016 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-6387202a-8190-482a-bb77-3eeaad3076c0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:07.113686 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-6387202a-8190-482a-bb77-3eeaad3076c0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:07.127336 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6387202a-8190-482a-bb77-3eeaad3076c0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:07.128351 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6387202a-8190-482a-bb77-3eeaad3076c0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:07.129346 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6387202a-8190-482a-bb77-3eeaad3076c0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:07.129823 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6387202a-8190-482a-bb77-3eeaad3076c0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:07.403978 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-6387202a-8190-482a-bb77-3eeaad3076c0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:07.413598 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-6387202a-8190-482a-bb77-3eeaad3076c0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:07.417816 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-6387202a-8190-482a-bb77-3eeaad3076c0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:07.419137 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-6387202a-8190-482a-bb77-3eeaad3076c0 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1729 microversion: 2.20 time: 0.311403 Dec 15 13:11:07.419770 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 591/1244] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:11:07 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1729 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:11:08.438892 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-76576d3e-1263-417a-812c-7be907108309 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:08.440772 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-76576d3e-1263-417a-812c-7be907108309 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:08.451312 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76576d3e-1263-417a-812c-7be907108309 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:08.459502 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76576d3e-1263-417a-812c-7be907108309 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:08.460773 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76576d3e-1263-417a-812c-7be907108309 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:08.461416 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76576d3e-1263-417a-812c-7be907108309 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:08.742531 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-76576d3e-1263-417a-812c-7be907108309 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:08.751884 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-76576d3e-1263-417a-812c-7be907108309 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:08.753725 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-76576d3e-1263-417a-812c-7be907108309 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:08.755294 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-76576d3e-1263-417a-812c-7be907108309 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1729 microversion: 2.20 time: 0.320269 Dec 15 13:11:08.755958 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 654/1245] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:11:08 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1729 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:11:09.777267 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-1642e1c7-02c5-46a4-bbc0-7b0bff582cdb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:09.777879 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-1642e1c7-02c5-46a4-bbc0-7b0bff582cdb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:09.785126 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1642e1c7-02c5-46a4-bbc0-7b0bff582cdb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:09.785581 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1642e1c7-02c5-46a4-bbc0-7b0bff582cdb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:09.786410 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1642e1c7-02c5-46a4-bbc0-7b0bff582cdb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:09.786875 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1642e1c7-02c5-46a4-bbc0-7b0bff582cdb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:09.938664 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-1642e1c7-02c5-46a4-bbc0-7b0bff582cdb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:09.947322 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-1642e1c7-02c5-46a4-bbc0-7b0bff582cdb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:09.948846 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-1642e1c7-02c5-46a4-bbc0-7b0bff582cdb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:09.950051 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-1642e1c7-02c5-46a4-bbc0-7b0bff582cdb tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1729 microversion: 2.20 time: 0.176636 Dec 15 13:11:09.950745 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 592/1246] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:11:09 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:11:10.968556 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e8656717-47fa-4d7b-974c-9c72e6592727 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:10.969995 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e8656717-47fa-4d7b-974c-9c72e6592727 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:10.976733 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e8656717-47fa-4d7b-974c-9c72e6592727 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:10.977183 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e8656717-47fa-4d7b-974c-9c72e6592727 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:10.977963 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e8656717-47fa-4d7b-974c-9c72e6592727 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:10.978431 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e8656717-47fa-4d7b-974c-9c72e6592727 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:11.123733 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e8656717-47fa-4d7b-974c-9c72e6592727 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:11.135068 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e8656717-47fa-4d7b-974c-9c72e6592727 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:11.136958 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e8656717-47fa-4d7b-974c-9c72e6592727 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:11.138494 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e8656717-47fa-4d7b-974c-9c72e6592727 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1729 microversion: 2.20 time: 0.173508 Dec 15 13:11:11.139578 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 655/1247] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:11:10 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:11:12.158104 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-dc2d19d2-27c7-40aa-9d1b-f25f6362337c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:12.160030 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-dc2d19d2-27c7-40aa-9d1b-f25f6362337c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:12.168050 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dc2d19d2-27c7-40aa-9d1b-f25f6362337c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:12.168657 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dc2d19d2-27c7-40aa-9d1b-f25f6362337c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:12.169735 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dc2d19d2-27c7-40aa-9d1b-f25f6362337c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:12.170439 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-dc2d19d2-27c7-40aa-9d1b-f25f6362337c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:12.449506 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-dc2d19d2-27c7-40aa-9d1b-f25f6362337c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:12.459566 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-dc2d19d2-27c7-40aa-9d1b-f25f6362337c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:12.461407 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-dc2d19d2-27c7-40aa-9d1b-f25f6362337c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:12.462678 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-dc2d19d2-27c7-40aa-9d1b-f25f6362337c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1729 microversion: 2.20 time: 0.309485 Dec 15 13:11:12.473944 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 593/1248] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:11:12 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1729 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:11:13.499584 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-51eb1216-1c58-436c-b568-3e55e19dcde8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:13.521691 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-51eb1216-1c58-436c-b568-3e55e19dcde8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:13.536949 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-51eb1216-1c58-436c-b568-3e55e19dcde8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:13.537271 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-51eb1216-1c58-436c-b568-3e55e19dcde8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:13.538221 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-51eb1216-1c58-436c-b568-3e55e19dcde8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:13.538964 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-51eb1216-1c58-436c-b568-3e55e19dcde8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:13.758951 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-51eb1216-1c58-436c-b568-3e55e19dcde8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:13.770034 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-51eb1216-1c58-436c-b568-3e55e19dcde8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:13.771653 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-51eb1216-1c58-436c-b568-3e55e19dcde8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:13.772840 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-51eb1216-1c58-436c-b568-3e55e19dcde8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1729 microversion: 2.20 time: 0.288980 Dec 15 13:11:13.785797 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 656/1249] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:11:13 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1729 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:11:13.840631 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-023f1622-8398-4786-b452-c0107f1e2db6 req-cf85fdb4-10e1-4c2a-a5ed-a59550994b1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5328000e-dd8e-4bff-b035-2114c746691a", "name": "network-vif-plugged", "status": "completed", "tag": "78004f41-fe9a-4327-8c94-953fab674338"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:11:13.842250 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:11:13.842250 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:11:13.851793 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-023f1622-8398-4786-b452-c0107f1e2db6 req-cf85fdb4-10e1-4c2a-a5ed-a59550994b1f service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:13.852322 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-023f1622-8398-4786-b452-c0107f1e2db6 req-cf85fdb4-10e1-4c2a-a5ed-a59550994b1f service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:13.868145 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-023f1622-8398-4786-b452-c0107f1e2db6 req-cf85fdb4-10e1-4c2a-a5ed-a59550994b1f service nova] Creating event network-vif-plugged:78004f41-fe9a-4327-8c94-953fab674338 for instance 5328000e-dd8e-4bff-b035-2114c746691a on hv-cinder-81322 Dec 15 13:11:13.873988 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-023f1622-8398-4786-b452-c0107f1e2db6 req-cf85fdb4-10e1-4c2a-a5ed-a59550994b1f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036919 Dec 15 13:11:13.875240 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 594/1250] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:11:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:11:14.791806 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5f00cc41-1539-4e96-b6b4-950d66b2e389 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:14.792361 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5f00cc41-1539-4e96-b6b4-950d66b2e389 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:14.812643 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5f00cc41-1539-4e96-b6b4-950d66b2e389 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:14.814459 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5f00cc41-1539-4e96-b6b4-950d66b2e389 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:14.817025 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5f00cc41-1539-4e96-b6b4-950d66b2e389 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:14.818064 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5f00cc41-1539-4e96-b6b4-950d66b2e389 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:15.143522 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5f00cc41-1539-4e96-b6b4-950d66b2e389 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:15.152478 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5f00cc41-1539-4e96-b6b4-950d66b2e389 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:15.154125 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5f00cc41-1539-4e96-b6b4-950d66b2e389 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:15.155343 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5f00cc41-1539-4e96-b6b4-950d66b2e389 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1729 microversion: 2.20 time: 0.367781 Dec 15 13:11:15.167758 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 657/1251] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:11:14 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1729 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:11:16.177111 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-968933ce-ad67-495b-a1f7-e05f622b7dc8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:16.177725 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-968933ce-ad67-495b-a1f7-e05f622b7dc8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:16.189611 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-968933ce-ad67-495b-a1f7-e05f622b7dc8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:16.190366 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-968933ce-ad67-495b-a1f7-e05f622b7dc8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:16.192879 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-968933ce-ad67-495b-a1f7-e05f622b7dc8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:16.197796 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-968933ce-ad67-495b-a1f7-e05f622b7dc8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:16.354920 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-030bd3b4-d9fd-4285-a20f-ded473486826 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Action: 'create', calling method: .version_select at 0x7faf12fc00d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-763252721"}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:11:16.374001 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-030bd3b4-d9fd-4285-a20f-ded473486826 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Getting quotas for project 85b5372522d64067b34faa325b4dc400. Resources: {'key_pairs'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:11:16.379146 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-030bd3b4-d9fd-4285-a20f-ded473486826 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Getting quotas for user 913f4595b6444821801332dacab3c616 and project 85b5372522d64067b34faa325b4dc400. Resources: {'key_pairs'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:11:16.403477 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-968933ce-ad67-495b-a1f7-e05f622b7dc8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:16.417965 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-968933ce-ad67-495b-a1f7-e05f622b7dc8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:16.419519 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-968933ce-ad67-495b-a1f7-e05f622b7dc8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:16.423063 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-968933ce-ad67-495b-a1f7-e05f622b7dc8 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1729 microversion: 2.20 time: 0.251849 Dec 15 13:11:16.424170 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 658/1252] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:11:16 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1729 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:11:16.540343 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-030bd3b4-d9fd-4285-a20f-ded473486826 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Getting quotas for project 85b5372522d64067b34faa325b4dc400. Resources: {'key_pairs'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:11:16.544734 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-030bd3b4-d9fd-4285-a20f-ded473486826 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Getting quotas for user 913f4595b6444821801332dacab3c616 and project 85b5372522d64067b34faa325b4dc400. Resources: {'key_pairs'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:11:16.561168 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-030bd3b4-d9fd-4285-a20f-ded473486826 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.432240 Dec 15 13:11:16.561760 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 595/1253] 10.222.0.57 () {60 vars in 1157 bytes} [Wed Dec 15 13:11:16 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:17.442933 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7d0b6053-bb68-40d4-a2c5-af04d51acfad tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:17.443555 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7d0b6053-bb68-40d4-a2c5-af04d51acfad tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:17.450205 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7d0b6053-bb68-40d4-a2c5-af04d51acfad tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:17.450626 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7d0b6053-bb68-40d4-a2c5-af04d51acfad tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:17.451443 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7d0b6053-bb68-40d4-a2c5-af04d51acfad tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:17.451878 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7d0b6053-bb68-40d4-a2c5-af04d51acfad tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:17.607594 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-7d0b6053-bb68-40d4-a2c5-af04d51acfad tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:17.617736 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-7d0b6053-bb68-40d4-a2c5-af04d51acfad tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:17.619259 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-7d0b6053-bb68-40d4-a2c5-af04d51acfad tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:17.620543 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7d0b6053-bb68-40d4-a2c5-af04d51acfad tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1716 microversion: 2.20 time: 0.183015 Dec 15 13:11:17.621294 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 659/1254] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:11:17 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1716 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:11:33.772594 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-38cf959e-682e-4df8-ad75-40dae9004680 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2007875766", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-763252721", "security_groups": [{"name": "tempest-secgroup-smoke-1611347591"}], "block_device_mapping_v2": [{"uuid": "a626e19c-20a0-49cf-a302-8d123b2a6f84", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5eab384c-36ea-4de9-9630-bc1a7d6a1dac"}]}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:11:33.880315 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.network.neutron [None req-38cf959e-682e-4df8-ad75-40dae9004680 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] validate_networks() for [('5eab384c-36ea-4de9-9630-bc1a7d6a1dac', None, None, None, None, None)] {{(pid=116097) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:11:34.240938 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-38cf959e-682e-4df8-ad75-40dae9004680 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Flavor limits 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:11:34.241362 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-38cf959e-682e-4df8-ad75-40dae9004680 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Image limits 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:11:34.241837 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-38cf959e-682e-4df8-ad75-40dae9004680 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Flavor pref 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:11:34.242276 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-38cf959e-682e-4df8-ad75-40dae9004680 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Image pref 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:11:34.242690 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-38cf959e-682e-4df8-ad75-40dae9004680 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:11:34.251364 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-38cf959e-682e-4df8-ad75-40dae9004680 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:34.251810 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-38cf959e-682e-4df8-ad75-40dae9004680 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:34.252617 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-38cf959e-682e-4df8-ad75-40dae9004680 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:34.253058 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-38cf959e-682e-4df8-ad75-40dae9004680 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:34.269071 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-38cf959e-682e-4df8-ad75-40dae9004680 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Getting quotas for project 85b5372522d64067b34faa325b4dc400. Resources: {'instances', 'cores', 'ram'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:11:34.272962 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-38cf959e-682e-4df8-ad75-40dae9004680 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Getting quotas for user 913f4595b6444821801332dacab3c616 and project 85b5372522d64067b34faa325b4dc400. Resources: {'instances', 'cores', 'ram'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:11:34.328872 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-38cf959e-682e-4df8-ad75-40dae9004680 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Going to run 1 instances... {{(pid=116097) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:11:34.331149 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-38cf959e-682e-4df8-ad75-40dae9004680 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: b14ea93a-eff2-476e-9a50-8352bfa100f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a626e19c-20a0-49cf-a302-8d123b2a6f84',volume_size=None,volume_type=None)] {{(pid=116097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:11:34.457448 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-38cf959e-682e-4df8-ad75-40dae9004680 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.689055 Dec 15 13:11:34.458099 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 596/1255] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Dec 15 13:11:33 2021] POST /compute/v2.1/servers => generated 406 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:11:34.467858 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-65d682ca-0704-403b-be60-a37804fa46c9 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:34.468467 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-65d682ca-0704-403b-be60-a37804fa46c9 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: b14ea93a-eff2-476e-9a50-8352bfa100f9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:34.521080 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-65d682ca-0704-403b-be60-a37804fa46c9 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:34.527763 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-65d682ca-0704-403b-be60-a37804fa46c9 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9" status: 200 len: 1094 microversion: 2.1 time: 0.063494 Dec 15 13:11:34.528333 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 660/1256] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:34 2021] GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:35.543653 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-083512f3-0750-4c6f-a846-ba44e4ced83f tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:35.544340 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-083512f3-0750-4c6f-a846-ba44e4ced83f tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: b14ea93a-eff2-476e-9a50-8352bfa100f9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:35.552237 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-083512f3-0750-4c6f-a846-ba44e4ced83f tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:35.552687 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-083512f3-0750-4c6f-a846-ba44e4ced83f tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:35.553471 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-083512f3-0750-4c6f-a846-ba44e4ced83f tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:35.553903 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-083512f3-0750-4c6f-a846-ba44e4ced83f tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:35.614057 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-083512f3-0750-4c6f-a846-ba44e4ced83f tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:35.621881 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-083512f3-0750-4c6f-a846-ba44e4ced83f tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9" status: 200 len: 1210 microversion: 2.1 time: 0.082003 Dec 15 13:11:35.622499 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 597/1257] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:35 2021] GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9 => generated 1210 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:36.639747 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-05c55420-9a26-41d2-82b7-7e9b15d29b58 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:36.640359 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-05c55420-9a26-41d2-82b7-7e9b15d29b58 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: b14ea93a-eff2-476e-9a50-8352bfa100f9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:36.647435 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-05c55420-9a26-41d2-82b7-7e9b15d29b58 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:36.647916 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-05c55420-9a26-41d2-82b7-7e9b15d29b58 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:36.648699 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-05c55420-9a26-41d2-82b7-7e9b15d29b58 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:36.649136 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-05c55420-9a26-41d2-82b7-7e9b15d29b58 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:36.733849 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-9c192b30-303a-47a9-b99f-a2a3ef727765 req-e1aa2ae0-e1c0-4a3d-918f-58ae8a5e4793 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b14ea93a-eff2-476e-9a50-8352bfa100f9", "tag": "0d76c703-26be-4464-bcdf-c6f7e1de4cf3"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:11:36.741417 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:11:36.741417 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:11:36.756634 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-9c192b30-303a-47a9-b99f-a2a3ef727765 req-e1aa2ae0-e1c0-4a3d-918f-58ae8a5e4793 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:36.757916 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-9c192b30-303a-47a9-b99f-a2a3ef727765 req-e1aa2ae0-e1c0-4a3d-918f-58ae8a5e4793 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:36.774180 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-9c192b30-303a-47a9-b99f-a2a3ef727765 req-e1aa2ae0-e1c0-4a3d-918f-58ae8a5e4793 service nova] Creating event network-changed:0d76c703-26be-4464-bcdf-c6f7e1de4cf3 for instance b14ea93a-eff2-476e-9a50-8352bfa100f9 on hv-cinder-81322 Dec 15 13:11:36.787233 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-9c192b30-303a-47a9-b99f-a2a3ef727765 req-e1aa2ae0-e1c0-4a3d-918f-58ae8a5e4793 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057028 Dec 15 13:11:36.788193 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 598/1258] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:11:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:11:36.871736 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-05c55420-9a26-41d2-82b7-7e9b15d29b58 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:36.880941 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-05c55420-9a26-41d2-82b7-7e9b15d29b58 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9" status: 200 len: 1266 microversion: 2.1 time: 0.245438 Dec 15 13:11:36.881538 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 661/1259] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:36 2021] GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9 => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:11:37.898970 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-ae9893b2-af58-4bda-9384-9df7f7510c8e tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:37.899656 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-ae9893b2-af58-4bda-9384-9df7f7510c8e tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: b14ea93a-eff2-476e-9a50-8352bfa100f9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:37.905583 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ae9893b2-af58-4bda-9384-9df7f7510c8e tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:37.906032 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ae9893b2-af58-4bda-9384-9df7f7510c8e tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:37.906825 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ae9893b2-af58-4bda-9384-9df7f7510c8e tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:37.907258 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ae9893b2-af58-4bda-9384-9df7f7510c8e tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:38.043023 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-ae9893b2-af58-4bda-9384-9df7f7510c8e tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:38.051247 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-ae9893b2-af58-4bda-9384-9df7f7510c8e tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9" status: 200 len: 1266 microversion: 2.1 time: 0.156722 Dec 15 13:11:38.051808 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 599/1260] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:37 2021] GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:39.068039 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-93db574c-35bc-454a-8722-99ebebdd996b tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:39.068577 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-93db574c-35bc-454a-8722-99ebebdd996b tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: b14ea93a-eff2-476e-9a50-8352bfa100f9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:39.075500 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-93db574c-35bc-454a-8722-99ebebdd996b tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:39.075988 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-93db574c-35bc-454a-8722-99ebebdd996b tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:39.077125 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-93db574c-35bc-454a-8722-99ebebdd996b tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:39.077586 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-93db574c-35bc-454a-8722-99ebebdd996b tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:39.211665 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-93db574c-35bc-454a-8722-99ebebdd996b tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:39.219001 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-93db574c-35bc-454a-8722-99ebebdd996b tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9" status: 200 len: 1266 microversion: 2.1 time: 0.154720 Dec 15 13:11:39.219575 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 662/1261] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:39 2021] GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:11:40.235642 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-57b1d9e7-9f39-46bc-b550-5ffa1e3b2f18 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:40.236272 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-57b1d9e7-9f39-46bc-b550-5ffa1e3b2f18 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: b14ea93a-eff2-476e-9a50-8352bfa100f9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:40.242580 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-57b1d9e7-9f39-46bc-b550-5ffa1e3b2f18 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:40.243039 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-57b1d9e7-9f39-46bc-b550-5ffa1e3b2f18 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:40.243824 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-57b1d9e7-9f39-46bc-b550-5ffa1e3b2f18 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:40.244263 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-57b1d9e7-9f39-46bc-b550-5ffa1e3b2f18 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:40.380544 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-57b1d9e7-9f39-46bc-b550-5ffa1e3b2f18 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:40.388314 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-57b1d9e7-9f39-46bc-b550-5ffa1e3b2f18 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9" status: 200 len: 1266 microversion: 2.1 time: 0.156370 Dec 15 13:11:40.388871 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 600/1262] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:40 2021] GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:41.404994 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4112c47f-67bc-4875-b389-101d02a18752 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:41.405598 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4112c47f-67bc-4875-b389-101d02a18752 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: b14ea93a-eff2-476e-9a50-8352bfa100f9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:41.411918 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4112c47f-67bc-4875-b389-101d02a18752 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:41.412364 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4112c47f-67bc-4875-b389-101d02a18752 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:41.413143 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4112c47f-67bc-4875-b389-101d02a18752 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:41.413576 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4112c47f-67bc-4875-b389-101d02a18752 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:41.543063 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4112c47f-67bc-4875-b389-101d02a18752 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:41.550845 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4112c47f-67bc-4875-b389-101d02a18752 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9" status: 200 len: 1266 microversion: 2.1 time: 0.149533 Dec 15 13:11:41.551602 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 663/1263] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:41 2021] GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:42.567541 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-3200ab67-c156-4592-8683-bbea4e8b9e08 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:42.568188 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-3200ab67-c156-4592-8683-bbea4e8b9e08 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: b14ea93a-eff2-476e-9a50-8352bfa100f9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:42.574658 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3200ab67-c156-4592-8683-bbea4e8b9e08 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:42.575338 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3200ab67-c156-4592-8683-bbea4e8b9e08 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:42.575886 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3200ab67-c156-4592-8683-bbea4e8b9e08 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:42.576321 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3200ab67-c156-4592-8683-bbea4e8b9e08 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:42.712262 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-3200ab67-c156-4592-8683-bbea4e8b9e08 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:42.719645 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-3200ab67-c156-4592-8683-bbea4e8b9e08 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9" status: 200 len: 1266 microversion: 2.1 time: 0.155763 Dec 15 13:11:42.720838 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 601/1264] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:42 2021] GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:43.737463 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1ea15e48-16e6-4ebf-9e43-4af3660c7f82 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:43.738105 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1ea15e48-16e6-4ebf-9e43-4af3660c7f82 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: b14ea93a-eff2-476e-9a50-8352bfa100f9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:43.744351 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1ea15e48-16e6-4ebf-9e43-4af3660c7f82 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:43.744800 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1ea15e48-16e6-4ebf-9e43-4af3660c7f82 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:43.745572 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1ea15e48-16e6-4ebf-9e43-4af3660c7f82 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:43.746005 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1ea15e48-16e6-4ebf-9e43-4af3660c7f82 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:43.880747 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1ea15e48-16e6-4ebf-9e43-4af3660c7f82 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:43.888167 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1ea15e48-16e6-4ebf-9e43-4af3660c7f82 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9" status: 200 len: 1266 microversion: 2.1 time: 0.154936 Dec 15 13:11:43.888761 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 664/1265] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:43 2021] GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:44.904630 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-08d314d4-7b91-48ca-aa57-8cf9a9130575 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:44.905268 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-08d314d4-7b91-48ca-aa57-8cf9a9130575 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: b14ea93a-eff2-476e-9a50-8352bfa100f9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:44.912074 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-08d314d4-7b91-48ca-aa57-8cf9a9130575 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:44.912520 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-08d314d4-7b91-48ca-aa57-8cf9a9130575 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:44.913302 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-08d314d4-7b91-48ca-aa57-8cf9a9130575 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:44.913739 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-08d314d4-7b91-48ca-aa57-8cf9a9130575 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:45.039728 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-08d314d4-7b91-48ca-aa57-8cf9a9130575 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:45.046854 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-08d314d4-7b91-48ca-aa57-8cf9a9130575 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9" status: 200 len: 1266 microversion: 2.1 time: 0.145850 Dec 15 13:11:45.047412 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 602/1266] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:44 2021] GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:46.063031 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f44c0224-c54e-4bfc-b965-0d853dabe683 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:46.064171 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f44c0224-c54e-4bfc-b965-0d853dabe683 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: b14ea93a-eff2-476e-9a50-8352bfa100f9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:46.069953 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f44c0224-c54e-4bfc-b965-0d853dabe683 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:46.070426 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f44c0224-c54e-4bfc-b965-0d853dabe683 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:46.071184 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f44c0224-c54e-4bfc-b965-0d853dabe683 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:46.071613 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f44c0224-c54e-4bfc-b965-0d853dabe683 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:46.198238 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f44c0224-c54e-4bfc-b965-0d853dabe683 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:46.205924 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f44c0224-c54e-4bfc-b965-0d853dabe683 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9" status: 200 len: 1266 microversion: 2.1 time: 0.146712 Dec 15 13:11:46.206533 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 665/1267] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:46 2021] GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:47.223280 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-d013ec7b-0661-43a6-863c-60d6907c15a2 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:47.223920 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-d013ec7b-0661-43a6-863c-60d6907c15a2 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: b14ea93a-eff2-476e-9a50-8352bfa100f9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:47.229735 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d013ec7b-0661-43a6-863c-60d6907c15a2 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:47.230727 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d013ec7b-0661-43a6-863c-60d6907c15a2 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:47.230974 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d013ec7b-0661-43a6-863c-60d6907c15a2 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:47.231401 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d013ec7b-0661-43a6-863c-60d6907c15a2 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:47.364205 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-d013ec7b-0661-43a6-863c-60d6907c15a2 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:47.371878 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-d013ec7b-0661-43a6-863c-60d6907c15a2 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9" status: 200 len: 1266 microversion: 2.1 time: 0.152946 Dec 15 13:11:47.372450 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 603/1268] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:47 2021] GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:47.427726 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-698819d1-fc33-4514-bb8f-5324fd77074a req-241521dc-e026-4709-8822-df2f14fab1cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b14ea93a-eff2-476e-9a50-8352bfa100f9", "name": "network-vif-plugged", "status": "completed", "tag": "0d76c703-26be-4464-bcdf-c6f7e1de4cf3"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:11:47.429408 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:11:47.429408 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:11:47.437496 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-698819d1-fc33-4514-bb8f-5324fd77074a req-241521dc-e026-4709-8822-df2f14fab1cb service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:47.437953 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-698819d1-fc33-4514-bb8f-5324fd77074a req-241521dc-e026-4709-8822-df2f14fab1cb service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:47.450048 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-698819d1-fc33-4514-bb8f-5324fd77074a req-241521dc-e026-4709-8822-df2f14fab1cb service nova] Creating event network-vif-plugged:0d76c703-26be-4464-bcdf-c6f7e1de4cf3 for instance b14ea93a-eff2-476e-9a50-8352bfa100f9 on hv-cinder-81322 Dec 15 13:11:47.456086 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-698819d1-fc33-4514-bb8f-5324fd77074a req-241521dc-e026-4709-8822-df2f14fab1cb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032028 Dec 15 13:11:47.456703 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 666/1269] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:11:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:11:48.390324 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-e31323fa-7cf0-4f74-9a93-4ad6fe2e633e tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:48.392206 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-e31323fa-7cf0-4f74-9a93-4ad6fe2e633e tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: b14ea93a-eff2-476e-9a50-8352bfa100f9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:48.400373 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e31323fa-7cf0-4f74-9a93-4ad6fe2e633e tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:48.400822 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e31323fa-7cf0-4f74-9a93-4ad6fe2e633e tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:48.401630 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e31323fa-7cf0-4f74-9a93-4ad6fe2e633e tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:48.402068 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e31323fa-7cf0-4f74-9a93-4ad6fe2e633e tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:48.538635 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-e31323fa-7cf0-4f74-9a93-4ad6fe2e633e tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:48.545996 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-e31323fa-7cf0-4f74-9a93-4ad6fe2e633e tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9" status: 200 len: 1266 microversion: 2.1 time: 0.160289 Dec 15 13:11:48.546602 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 604/1270] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:48 2021] GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:49.563670 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8e3da410-266e-42fe-af68-26f43ae5face tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:49.564370 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8e3da410-266e-42fe-af68-26f43ae5face tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: b14ea93a-eff2-476e-9a50-8352bfa100f9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:49.570561 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8e3da410-266e-42fe-af68-26f43ae5face tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:49.571036 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8e3da410-266e-42fe-af68-26f43ae5face tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:49.571810 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8e3da410-266e-42fe-af68-26f43ae5face tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:49.572244 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8e3da410-266e-42fe-af68-26f43ae5face tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:49.710726 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8e3da410-266e-42fe-af68-26f43ae5face tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:49.718351 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8e3da410-266e-42fe-af68-26f43ae5face tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9" status: 200 len: 1452 microversion: 2.1 time: 0.159034 Dec 15 13:11:49.718925 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 667/1271] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:49 2021] GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:49.735169 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-3e4788cb-88e4-4bbb-a45e-cacd0bd26f33 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:49.735771 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-3e4788cb-88e4-4bbb-a45e-cacd0bd26f33 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: b14ea93a-eff2-476e-9a50-8352bfa100f9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:49.742003 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3e4788cb-88e4-4bbb-a45e-cacd0bd26f33 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:49.742478 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3e4788cb-88e4-4bbb-a45e-cacd0bd26f33 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:49.743246 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3e4788cb-88e4-4bbb-a45e-cacd0bd26f33 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:49.743670 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3e4788cb-88e4-4bbb-a45e-cacd0bd26f33 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:49.876837 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-3e4788cb-88e4-4bbb-a45e-cacd0bd26f33 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:49.884761 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-3e4788cb-88e4-4bbb-a45e-cacd0bd26f33 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9" status: 200 len: 1452 microversion: 2.1 time: 0.153161 Dec 15 13:11:49.885341 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 605/1272] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:49 2021] GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:50.671735 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0f927d8e-bbfe-46d8-8f3e-c54a4aabb69e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:50.673369 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0f927d8e-bbfe-46d8-8f3e-c54a4aabb69e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:50.680270 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0f927d8e-bbfe-46d8-8f3e-c54a4aabb69e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:50.680816 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0f927d8e-bbfe-46d8-8f3e-c54a4aabb69e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:50.681690 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0f927d8e-bbfe-46d8-8f3e-c54a4aabb69e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:50.682199 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0f927d8e-bbfe-46d8-8f3e-c54a4aabb69e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:50.711216 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-0f927d8e-bbfe-46d8-8f3e-c54a4aabb69e tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043154 Dec 15 13:11:50.712052 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 668/1273] 10.222.0.57 () {60 vars in 1342 bytes} [Wed Dec 15 13:11:50 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:50.771541 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-cd71594f-82d7-4b7c-83d2-2309dc26c70c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:50.772099 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-cd71594f-82d7-4b7c-83d2-2309dc26c70c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:50.778276 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cd71594f-82d7-4b7c-83d2-2309dc26c70c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:50.778731 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cd71594f-82d7-4b7c-83d2-2309dc26c70c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:50.779527 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cd71594f-82d7-4b7c-83d2-2309dc26c70c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:50.779964 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cd71594f-82d7-4b7c-83d2-2309dc26c70c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:50.809198 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-cd71594f-82d7-4b7c-83d2-2309dc26c70c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Going to try to terminate instance {{(pid=116097) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:11:50.899930 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-cd71594f-82d7-4b7c-83d2-2309dc26c70c tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 204 len: 0 microversion: 2.20 time: 0.132405 Dec 15 13:11:50.901005 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 606/1274] 10.222.0.57 () {60 vars in 1279 bytes} [Wed Dec 15 13:11:50 2021] DELETE /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 13:11:50.909944 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-22d834cb-e2ce-4478-be38-f26975757b8b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:50.910583 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-22d834cb-e2ce-4478-be38-f26975757b8b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:50.916439 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-22d834cb-e2ce-4478-be38-f26975757b8b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:50.916887 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-22d834cb-e2ce-4478-be38-f26975757b8b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:50.917674 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-22d834cb-e2ce-4478-be38-f26975757b8b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:50.920966 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-22d834cb-e2ce-4478-be38-f26975757b8b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:51.389313 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-22d834cb-e2ce-4478-be38-f26975757b8b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:51.397872 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-22d834cb-e2ce-4478-be38-f26975757b8b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:51.399395 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-22d834cb-e2ce-4478-be38-f26975757b8b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:51.400556 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-22d834cb-e2ce-4478-be38-f26975757b8b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1722 microversion: 2.20 time: 0.495041 Dec 15 13:11:51.401119 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 669/1275] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:11:50 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1722 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:11:51.912281 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-3f9f59c7-2dbb-4860-a677-84f47c0e8ac1 req-3911287c-80bc-46c2-a1dc-0081d65ef96a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b14ea93a-eff2-476e-9a50-8352bfa100f9", "tag": "0d76c703-26be-4464-bcdf-c6f7e1de4cf3"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:11:51.913792 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:11:51.913792 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:11:51.922176 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-3f9f59c7-2dbb-4860-a677-84f47c0e8ac1 req-3911287c-80bc-46c2-a1dc-0081d65ef96a service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:51.923151 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-3f9f59c7-2dbb-4860-a677-84f47c0e8ac1 req-3911287c-80bc-46c2-a1dc-0081d65ef96a service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:51.934532 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-3f9f59c7-2dbb-4860-a677-84f47c0e8ac1 req-3911287c-80bc-46c2-a1dc-0081d65ef96a service nova] Creating event network-changed:0d76c703-26be-4464-bcdf-c6f7e1de4cf3 for instance b14ea93a-eff2-476e-9a50-8352bfa100f9 on hv-cinder-81322 Dec 15 13:11:51.940024 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-3f9f59c7-2dbb-4860-a677-84f47c0e8ac1 req-3911287c-80bc-46c2-a1dc-0081d65ef96a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031713 Dec 15 13:11:51.940609 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 607/1276] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:11:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:11:52.418115 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-73e87563-7982-4a2b-bf4b-dc4e12a50773 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:52.419419 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-73e87563-7982-4a2b-bf4b-dc4e12a50773 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:52.426104 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-73e87563-7982-4a2b-bf4b-dc4e12a50773 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:52.426929 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-73e87563-7982-4a2b-bf4b-dc4e12a50773 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:52.428269 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-73e87563-7982-4a2b-bf4b-dc4e12a50773 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:52.428766 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-73e87563-7982-4a2b-bf4b-dc4e12a50773 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:52.617494 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-73e87563-7982-4a2b-bf4b-dc4e12a50773 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:52.626939 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-73e87563-7982-4a2b-bf4b-dc4e12a50773 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:52.628318 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-73e87563-7982-4a2b-bf4b-dc4e12a50773 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:52.629547 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-73e87563-7982-4a2b-bf4b-dc4e12a50773 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1722 microversion: 2.20 time: 0.215319 Dec 15 13:11:52.630616 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 670/1277] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:11:52 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:11:53.499648 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-4ed6677f-d2c7-4124-a030-8e1d741fe56c req-d9104d43-ec3d-4f5b-a133-347e09162a82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5328000e-dd8e-4bff-b035-2114c746691a", "name": "network-vif-deleted", "tag": "78004f41-fe9a-4327-8c94-953fab674338"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:11:53.500763 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:11:53.500763 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:11:53.511227 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-4ed6677f-d2c7-4124-a030-8e1d741fe56c req-d9104d43-ec3d-4f5b-a133-347e09162a82 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:53.511663 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-4ed6677f-d2c7-4124-a030-8e1d741fe56c req-d9104d43-ec3d-4f5b-a133-347e09162a82 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:53.523927 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-4ed6677f-d2c7-4124-a030-8e1d741fe56c req-d9104d43-ec3d-4f5b-a133-347e09162a82 service nova] Creating event network-vif-deleted:78004f41-fe9a-4327-8c94-953fab674338 for instance 5328000e-dd8e-4bff-b035-2114c746691a on hv-cinder-81322 Dec 15 13:11:53.529363 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-4ed6677f-d2c7-4124-a030-8e1d741fe56c req-d9104d43-ec3d-4f5b-a133-347e09162a82 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034487 Dec 15 13:11:53.529952 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 608/1278] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:11:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:11:53.651584 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5267222b-d673-429e-b02b-c4cdf5bb8216 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:53.652596 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5267222b-d673-429e-b02b-c4cdf5bb8216 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:53.666102 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5267222b-d673-429e-b02b-c4cdf5bb8216 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:53.667237 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5267222b-d673-429e-b02b-c4cdf5bb8216 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:53.668389 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5267222b-d673-429e-b02b-c4cdf5bb8216 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:53.669058 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5267222b-d673-429e-b02b-c4cdf5bb8216 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:53.711608 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5267222b-d673-429e-b02b-c4cdf5bb8216 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:53.712626 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5267222b-d673-429e-b02b-c4cdf5bb8216 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:53.713367 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.objects.instance [None req-5267222b-d673-429e-b02b-c4cdf5bb8216 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lazy-loading 'fault' on Instance uuid 5328000e-dd8e-4bff-b035-2114c746691a {{(pid=116098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:11:53.764950 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5267222b-d673-429e-b02b-c4cdf5bb8216 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:53.772516 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5267222b-d673-429e-b02b-c4cdf5bb8216 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:53.774026 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5267222b-d673-429e-b02b-c4cdf5bb8216 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1431bb04bd14db986edcf8931bc2210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fda976fb52842e28027e89e4d6752fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:53.775388 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5267222b-d673-429e-b02b-c4cdf5bb8216 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 200 len: 1371 microversion: 2.20 time: 0.130375 Dec 15 13:11:53.775947 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 671/1279] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:11:53 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 1371 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:11:54.795600 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-3f808852-1dde-4b0f-8470-1d060e658260 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:54.796278 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-3f808852-1dde-4b0f-8470-1d060e658260 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:54.802958 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3f808852-1dde-4b0f-8470-1d060e658260 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:54.803407 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3f808852-1dde-4b0f-8470-1d060e658260 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:54.804185 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3f808852-1dde-4b0f-8470-1d060e658260 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:54.804616 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3f808852-1dde-4b0f-8470-1d060e658260 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:54.819720 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.wsgi [None req-3f808852-1dde-4b0f-8470-1d060e658260 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] HTTP exception thrown: Instance 5328000e-dd8e-4bff-b035-2114c746691a could not be found. Dec 15 13:11:54.819720 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-3f808852-1dde-4b0f-8470-1d060e658260 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Returning 404 to user: Instance 5328000e-dd8e-4bff-b035-2114c746691a could not be found. {{(pid=116097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:11:54.820782 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-3f808852-1dde-4b0f-8470-1d060e658260 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 404 len: 111 microversion: 2.20 time: 0.029777 Dec 15 13:11:54.821027 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 609/1280] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:11:54 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:11:54.829114 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ac6b2eef-d04f-4e25-9ca3-42cdecac566b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '.version_select at 0x7faf182e4f70>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:54.846581 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ac6b2eef-d04f-4e25-9ca3-42cdecac566b tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1092440350" status: 204 len: 0 microversion: 2.20 time: 0.020986 Dec 15 13:11:54.847144 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 672/1281] 10.222.0.57 () {60 vars in 1261 bytes} [Wed Dec 15 13:11:54 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1092440350 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 13:11:56.629663 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-1788b07a-6490-4c9b-81b4-e05172733e9f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:56.630257 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-1788b07a-6490-4c9b-81b4-e05172733e9f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:56.636635 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1788b07a-6490-4c9b-81b4-e05172733e9f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:56.637079 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1788b07a-6490-4c9b-81b4-e05172733e9f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:56.637848 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1788b07a-6490-4c9b-81b4-e05172733e9f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:56.638312 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1788b07a-6490-4c9b-81b4-e05172733e9f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:56.652729 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.wsgi [None req-1788b07a-6490-4c9b-81b4-e05172733e9f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] HTTP exception thrown: Instance 5328000e-dd8e-4bff-b035-2114c746691a could not be found. Dec 15 13:11:56.653303 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-1788b07a-6490-4c9b-81b4-e05172733e9f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Returning 404 to user: Instance 5328000e-dd8e-4bff-b035-2114c746691a could not be found. {{(pid=116097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:11:56.654116 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-1788b07a-6490-4c9b-81b4-e05172733e9f tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 404 len: 111 microversion: 2.20 time: 0.028167 Dec 15 13:11:56.654688 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 610/1282] 10.222.0.57 () {60 vars in 1279 bytes} [Wed Dec 15 13:11:56 2021] DELETE /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:11:56.664235 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e319f591-3882-472b-be9c-b261b2e257a3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:56.664835 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e319f591-3882-472b-be9c-b261b2e257a3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 5328000e-dd8e-4bff-b035-2114c746691a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:56.671266 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e319f591-3882-472b-be9c-b261b2e257a3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:56.671715 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e319f591-3882-472b-be9c-b261b2e257a3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:56.673066 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e319f591-3882-472b-be9c-b261b2e257a3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:56.673500 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e319f591-3882-472b-be9c-b261b2e257a3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:56.686351 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-e319f591-3882-472b-be9c-b261b2e257a3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] HTTP exception thrown: Instance 5328000e-dd8e-4bff-b035-2114c746691a could not be found. Dec 15 13:11:56.686941 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e319f591-3882-472b-be9c-b261b2e257a3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Returning 404 to user: Instance 5328000e-dd8e-4bff-b035-2114c746691a could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:11:56.687765 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e319f591-3882-472b-be9c-b261b2e257a3 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a" status: 404 len: 111 microversion: 2.20 time: 0.028306 Dec 15 13:11:56.688305 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 673/1283] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:11:56 2021] GET /compute/v2.1/servers/5328000e-dd8e-4bff-b035-2114c746691a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:11:57.820997 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-74982693-1c00-42f4-bfc9-2ed813dd0237 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:57.821518 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-74982693-1c00-42f4-bfc9-2ed813dd0237 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:57.827753 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-74982693-1c00-42f4-bfc9-2ed813dd0237 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:57.828195 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-74982693-1c00-42f4-bfc9-2ed813dd0237 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:57.828971 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-74982693-1c00-42f4-bfc9-2ed813dd0237 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:57.829402 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-74982693-1c00-42f4-bfc9-2ed813dd0237 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:57.843646 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.wsgi [None req-74982693-1c00-42f4-bfc9-2ed813dd0237 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] HTTP exception thrown: Instance 703b5e88-39f0-436c-ac5a-f1701ec4d7c9 could not be found. Dec 15 13:11:57.843646 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-74982693-1c00-42f4-bfc9-2ed813dd0237 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Returning 404 to user: Instance 703b5e88-39f0-436c-ac5a-f1701ec4d7c9 could not be found. {{(pid=116097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:11:57.844033 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-74982693-1c00-42f4-bfc9-2ed813dd0237 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "DELETE /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 404 len: 111 microversion: 2.20 time: 0.026706 Dec 15 13:11:57.844959 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 611/1284] 10.222.0.57 () {60 vars in 1279 bytes} [Wed Dec 15 13:11:57 2021] DELETE /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:11:57.852594 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-cd865a4c-c81d-4577-8710-9a2fa79e2410 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:57.853289 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-cd865a4c-c81d-4577-8710-9a2fa79e2410 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] [instance: 703b5e88-39f0-436c-ac5a-f1701ec4d7c9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:57.860500 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cd865a4c-c81d-4577-8710-9a2fa79e2410 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:57.860962 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cd865a4c-c81d-4577-8710-9a2fa79e2410 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:57.861721 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cd865a4c-c81d-4577-8710-9a2fa79e2410 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:57.862181 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cd865a4c-c81d-4577-8710-9a2fa79e2410 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:57.876459 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-cd865a4c-c81d-4577-8710-9a2fa79e2410 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] HTTP exception thrown: Instance 703b5e88-39f0-436c-ac5a-f1701ec4d7c9 could not be found. Dec 15 13:11:57.877045 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-cd865a4c-c81d-4577-8710-9a2fa79e2410 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] Returning 404 to user: Instance 703b5e88-39f0-436c-ac5a-f1701ec4d7c9 could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:11:57.877869 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-cd865a4c-c81d-4577-8710-9a2fa79e2410 tempest-AttachVolumeShelveTestJSON-209658994 tempest-AttachVolumeShelveTestJSON-209658994-project] 10.222.0.57 "GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9" status: 404 len: 111 microversion: 2.20 time: 0.028999 Dec 15 13:11:57.878455 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 674/1285] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Dec 15 13:11:57 2021] GET /compute/v2.1/servers/703b5e88-39f0-436c-ac5a-f1701ec4d7c9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 15 13:12:42.732749 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-3c59f33e-b38c-40b4-954c-caf7f0666d2a tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:12:42.733335 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-3c59f33e-b38c-40b4-954c-caf7f0666d2a tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:42.739018 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3c59f33e-b38c-40b4-954c-caf7f0666d2a tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:42.739463 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3c59f33e-b38c-40b4-954c-caf7f0666d2a tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:42.740231 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3c59f33e-b38c-40b4-954c-caf7f0666d2a tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:42.740661 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-3c59f33e-b38c-40b4-954c-caf7f0666d2a tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:42.762753 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.objects.instance [None req-3c59f33e-b38c-40b4-954c-caf7f0666d2a tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lazy-loading 'flavor' on Instance uuid 619e3772-5547-4f07-b126-5b6482ad8749 {{(pid=116097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:12:42.834674 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-3c59f33e-b38c-40b4-954c-caf7f0666d2a tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "POST /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749/action" status: 202 len: 0 microversion: 2.1 time: 0.105783 Dec 15 13:12:42.835269 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 612/1286] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:12:42 2021] POST /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:12:42.843148 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1c1296e1-90dc-4a30-9a9c-0186530c17f7 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:42.843756 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1c1296e1-90dc-4a30-9a9c-0186530c17f7 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:42.849815 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1c1296e1-90dc-4a30-9a9c-0186530c17f7 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:42.850344 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1c1296e1-90dc-4a30-9a9c-0186530c17f7 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:42.851205 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1c1296e1-90dc-4a30-9a9c-0186530c17f7 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:42.851663 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1c1296e1-90dc-4a30-9a9c-0186530c17f7 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:42.982572 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1c1296e1-90dc-4a30-9a9c-0186530c17f7 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:42.990977 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1c1296e1-90dc-4a30-9a9c-0186530c17f7 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1566 microversion: 2.1 time: 0.151382 Dec 15 13:12:42.991480 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 675/1287] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:42 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:44.010449 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-c99e4daf-7180-4f0c-9ae4-74975739cdf2 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:44.011253 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-c99e4daf-7180-4f0c-9ae4-74975739cdf2 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:44.017652 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c99e4daf-7180-4f0c-9ae4-74975739cdf2 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:44.018077 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c99e4daf-7180-4f0c-9ae4-74975739cdf2 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:44.018952 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c99e4daf-7180-4f0c-9ae4-74975739cdf2 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:44.019410 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c99e4daf-7180-4f0c-9ae4-74975739cdf2 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:44.171521 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-c99e4daf-7180-4f0c-9ae4-74975739cdf2 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:44.182392 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-c99e4daf-7180-4f0c-9ae4-74975739cdf2 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1566 microversion: 2.1 time: 0.176939 Dec 15 13:12:44.182962 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 613/1288] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:44 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:45.201712 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8f79f031-39ad-45d6-9fa5-ad5559494d92 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:45.202612 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8f79f031-39ad-45d6-9fa5-ad5559494d92 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:45.208411 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8f79f031-39ad-45d6-9fa5-ad5559494d92 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:45.208929 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8f79f031-39ad-45d6-9fa5-ad5559494d92 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:45.209704 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8f79f031-39ad-45d6-9fa5-ad5559494d92 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:45.210222 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8f79f031-39ad-45d6-9fa5-ad5559494d92 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:45.343261 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8f79f031-39ad-45d6-9fa5-ad5559494d92 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:45.351249 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8f79f031-39ad-45d6-9fa5-ad5559494d92 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1566 microversion: 2.1 time: 0.154294 Dec 15 13:12:45.351803 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 676/1289] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:45 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:46.368498 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-1a9e2fde-06be-4bf8-9df9-ac37d3b2f4e0 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:46.369068 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-1a9e2fde-06be-4bf8-9df9-ac37d3b2f4e0 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:46.375248 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1a9e2fde-06be-4bf8-9df9-ac37d3b2f4e0 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:46.375706 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1a9e2fde-06be-4bf8-9df9-ac37d3b2f4e0 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:46.376485 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1a9e2fde-06be-4bf8-9df9-ac37d3b2f4e0 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:46.376926 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1a9e2fde-06be-4bf8-9df9-ac37d3b2f4e0 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:46.505537 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-1a9e2fde-06be-4bf8-9df9-ac37d3b2f4e0 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:46.512798 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-1a9e2fde-06be-4bf8-9df9-ac37d3b2f4e0 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1566 microversion: 2.1 time: 0.148099 Dec 15 13:12:46.513364 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 614/1290] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:46 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:47.530627 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ebbe8fb1-a22b-407a-a645-0c9380b5f542 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:47.531225 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ebbe8fb1-a22b-407a-a645-0c9380b5f542 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:47.537480 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ebbe8fb1-a22b-407a-a645-0c9380b5f542 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:47.537922 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ebbe8fb1-a22b-407a-a645-0c9380b5f542 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:47.538732 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ebbe8fb1-a22b-407a-a645-0c9380b5f542 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:47.539163 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ebbe8fb1-a22b-407a-a645-0c9380b5f542 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:47.670835 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ebbe8fb1-a22b-407a-a645-0c9380b5f542 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:47.678683 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ebbe8fb1-a22b-407a-a645-0c9380b5f542 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1566 microversion: 2.1 time: 0.152730 Dec 15 13:12:47.679229 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 677/1291] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:47 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:48.695260 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-caad0205-fd9e-4052-8185-47ac343f6f45 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:48.695918 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-caad0205-fd9e-4052-8185-47ac343f6f45 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:48.702029 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-caad0205-fd9e-4052-8185-47ac343f6f45 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:48.702520 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-caad0205-fd9e-4052-8185-47ac343f6f45 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:48.703300 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-caad0205-fd9e-4052-8185-47ac343f6f45 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:48.703738 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-caad0205-fd9e-4052-8185-47ac343f6f45 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:48.913573 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-caad0205-fd9e-4052-8185-47ac343f6f45 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:48.920980 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-caad0205-fd9e-4052-8185-47ac343f6f45 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1566 microversion: 2.1 time: 0.229508 Dec 15 13:12:48.921853 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 615/1292] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:48 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1566 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:49.937369 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-bffd1051-2a02-4680-90b2-72b937fd5d56 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:49.937974 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-bffd1051-2a02-4680-90b2-72b937fd5d56 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:49.945202 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bffd1051-2a02-4680-90b2-72b937fd5d56 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:49.946042 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bffd1051-2a02-4680-90b2-72b937fd5d56 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:49.947424 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bffd1051-2a02-4680-90b2-72b937fd5d56 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:49.947935 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bffd1051-2a02-4680-90b2-72b937fd5d56 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:50.097526 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-bffd1051-2a02-4680-90b2-72b937fd5d56 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:50.105141 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-bffd1051-2a02-4680-90b2-72b937fd5d56 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1566 microversion: 2.1 time: 0.171356 Dec 15 13:12:50.105712 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 678/1293] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:49 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:51.121907 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-5fba4d9a-75c3-44a7-ba67-a1c8fadaeb5a tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:51.122541 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-5fba4d9a-75c3-44a7-ba67-a1c8fadaeb5a tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:51.128873 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5fba4d9a-75c3-44a7-ba67-a1c8fadaeb5a tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:51.129574 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5fba4d9a-75c3-44a7-ba67-a1c8fadaeb5a tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:51.130383 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5fba4d9a-75c3-44a7-ba67-a1c8fadaeb5a tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:51.130813 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-5fba4d9a-75c3-44a7-ba67-a1c8fadaeb5a tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:51.275985 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-5fba4d9a-75c3-44a7-ba67-a1c8fadaeb5a tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:51.283838 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-5fba4d9a-75c3-44a7-ba67-a1c8fadaeb5a tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1566 microversion: 2.1 time: 0.165027 Dec 15 13:12:51.284402 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 616/1294] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:51 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:52.302121 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1f04a8a4-6615-4037-924f-932b9555e33a tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:52.302733 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1f04a8a4-6615-4037-924f-932b9555e33a tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:52.309129 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1f04a8a4-6615-4037-924f-932b9555e33a tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:52.309575 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1f04a8a4-6615-4037-924f-932b9555e33a tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:52.310381 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1f04a8a4-6615-4037-924f-932b9555e33a tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:52.310816 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1f04a8a4-6615-4037-924f-932b9555e33a tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:52.449540 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1f04a8a4-6615-4037-924f-932b9555e33a tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:52.457115 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1f04a8a4-6615-4037-924f-932b9555e33a tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1566 microversion: 2.1 time: 0.159167 Dec 15 13:12:52.457661 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 679/1295] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:52 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:53.474038 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-ebc7319a-03be-4fd0-afdf-52c75b24036f tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:53.474818 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-ebc7319a-03be-4fd0-afdf-52c75b24036f tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:53.481161 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ebc7319a-03be-4fd0-afdf-52c75b24036f tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:53.481600 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ebc7319a-03be-4fd0-afdf-52c75b24036f tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:53.482428 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ebc7319a-03be-4fd0-afdf-52c75b24036f tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:53.482860 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-ebc7319a-03be-4fd0-afdf-52c75b24036f tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:53.637546 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-ebc7319a-03be-4fd0-afdf-52c75b24036f tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:53.648890 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-ebc7319a-03be-4fd0-afdf-52c75b24036f tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1566 microversion: 2.1 time: 0.175403 Dec 15 13:12:53.648890 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 617/1296] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:53 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1566 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:54.663814 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-bed99d17-65a2-437b-880e-ebae380d4919 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:54.664428 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-bed99d17-65a2-437b-880e-ebae380d4919 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:54.671513 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bed99d17-65a2-437b-880e-ebae380d4919 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:54.671959 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bed99d17-65a2-437b-880e-ebae380d4919 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:54.672739 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bed99d17-65a2-437b-880e-ebae380d4919 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:54.673172 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bed99d17-65a2-437b-880e-ebae380d4919 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:54.806358 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-bed99d17-65a2-437b-880e-ebae380d4919 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:54.814657 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-bed99d17-65a2-437b-880e-ebae380d4919 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1566 microversion: 2.1 time: 0.154219 Dec 15 13:12:54.815471 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 680/1297] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:54 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:55.832168 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-776a7625-f630-409b-8272-ff0386f4d4e7 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:55.833014 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-776a7625-f630-409b-8272-ff0386f4d4e7 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:55.839635 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-776a7625-f630-409b-8272-ff0386f4d4e7 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:55.840385 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-776a7625-f630-409b-8272-ff0386f4d4e7 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:55.841250 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-776a7625-f630-409b-8272-ff0386f4d4e7 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:55.841764 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-776a7625-f630-409b-8272-ff0386f4d4e7 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:55.990944 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-776a7625-f630-409b-8272-ff0386f4d4e7 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:55.999108 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-776a7625-f630-409b-8272-ff0386f4d4e7 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1567 microversion: 2.1 time: 0.170861 Dec 15 13:12:55.999676 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 618/1298] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:55 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:12:56.020348 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-2d0f05e8-220d-4c6b-993b-cfd98d287234 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:12:56.021190 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-2d0f05e8-220d-4c6b-993b-cfd98d287234 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:56.033608 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2d0f05e8-220d-4c6b-993b-cfd98d287234 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:56.033608 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2d0f05e8-220d-4c6b-993b-cfd98d287234 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:56.033608 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2d0f05e8-220d-4c6b-993b-cfd98d287234 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:56.033936 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2d0f05e8-220d-4c6b-993b-cfd98d287234 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:56.114308 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-2d0f05e8-220d-4c6b-993b-cfd98d287234 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "POST /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749/action" status: 202 len: 0 microversion: 2.1 time: 0.099564 Dec 15 13:12:56.114913 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 681/1299] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Dec 15 13:12:56 2021] POST /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:12:56.123562 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-9b520575-d635-4dae-943e-af2fb15cb7ec tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:56.124358 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-9b520575-d635-4dae-943e-af2fb15cb7ec tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:56.133108 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9b520575-d635-4dae-943e-af2fb15cb7ec tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:56.133853 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9b520575-d635-4dae-943e-af2fb15cb7ec tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:56.135326 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9b520575-d635-4dae-943e-af2fb15cb7ec tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:56.135892 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9b520575-d635-4dae-943e-af2fb15cb7ec tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:56.291554 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-9b520575-d635-4dae-943e-af2fb15cb7ec tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:56.299305 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-9b520575-d635-4dae-943e-af2fb15cb7ec tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1515 microversion: 2.1 time: 0.180164 Dec 15 13:12:56.302434 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 619/1300] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:56 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:57.319341 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5e6d2e62-a486-4ae2-b06f-0ff432ed1844 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:57.320051 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5e6d2e62-a486-4ae2-b06f-0ff432ed1844 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:57.326789 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5e6d2e62-a486-4ae2-b06f-0ff432ed1844 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:57.327226 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5e6d2e62-a486-4ae2-b06f-0ff432ed1844 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:57.327992 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5e6d2e62-a486-4ae2-b06f-0ff432ed1844 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:57.328427 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5e6d2e62-a486-4ae2-b06f-0ff432ed1844 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:57.464592 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5e6d2e62-a486-4ae2-b06f-0ff432ed1844 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:57.473360 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5e6d2e62-a486-4ae2-b06f-0ff432ed1844 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1573 microversion: 2.1 time: 0.158056 Dec 15 13:12:57.473918 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 682/1301] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:57 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:57.598777 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-4574e18c-f2d4-4be0-8ede-967691424818 req-cd7a3414-5c9d-41e7-8ad5-bb82fe8fd753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "619e3772-5547-4f07-b126-5b6482ad8749", "name": "network-vif-unplugged", "status": "completed", "tag": "22db1fdd-c799-4ae9-bc07-611872cd4207"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:12:57.600440 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:12:57.600440 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:12:57.609180 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-4574e18c-f2d4-4be0-8ede-967691424818 req-cd7a3414-5c9d-41e7-8ad5-bb82fe8fd753 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:57.609845 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-4574e18c-f2d4-4be0-8ede-967691424818 req-cd7a3414-5c9d-41e7-8ad5-bb82fe8fd753 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:57.623575 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-4574e18c-f2d4-4be0-8ede-967691424818 req-cd7a3414-5c9d-41e7-8ad5-bb82fe8fd753 service nova] Creating event network-vif-unplugged:22db1fdd-c799-4ae9-bc07-611872cd4207 for instance 619e3772-5547-4f07-b126-5b6482ad8749 on hv-cinder-81322 Dec 15 13:12:57.629760 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-4574e18c-f2d4-4be0-8ede-967691424818 req-cd7a3414-5c9d-41e7-8ad5-bb82fe8fd753 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035633 Dec 15 13:12:57.630526 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 620/1302] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:12:57 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:12:58.490925 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-65a72a17-2418-4b1f-860b-2b12952bcce2 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:58.491538 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-65a72a17-2418-4b1f-860b-2b12952bcce2 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:58.497995 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-65a72a17-2418-4b1f-860b-2b12952bcce2 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:58.498464 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-65a72a17-2418-4b1f-860b-2b12952bcce2 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:58.499238 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-65a72a17-2418-4b1f-860b-2b12952bcce2 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:58.499666 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-65a72a17-2418-4b1f-860b-2b12952bcce2 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:58.632708 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-65a72a17-2418-4b1f-860b-2b12952bcce2 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:58.640051 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-65a72a17-2418-4b1f-860b-2b12952bcce2 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1573 microversion: 2.1 time: 0.152828 Dec 15 13:12:58.640608 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 683/1303] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:58 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:59.657085 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-c16bc0f6-e07c-4466-a318-6d791a7aa6b8 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:59.657800 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-c16bc0f6-e07c-4466-a318-6d791a7aa6b8 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:59.664045 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c16bc0f6-e07c-4466-a318-6d791a7aa6b8 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:59.664497 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c16bc0f6-e07c-4466-a318-6d791a7aa6b8 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:59.665313 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c16bc0f6-e07c-4466-a318-6d791a7aa6b8 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:59.665756 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c16bc0f6-e07c-4466-a318-6d791a7aa6b8 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:59.849608 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-c16bc0f6-e07c-4466-a318-6d791a7aa6b8 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:59.857259 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-c16bc0f6-e07c-4466-a318-6d791a7aa6b8 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1573 microversion: 2.1 time: 0.204524 Dec 15 13:12:59.857862 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 621/1304] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:59 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1573 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:13:00.877585 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4e251c37-4093-4b83-95b0-66f9d4d86a6a tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:00.878283 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4e251c37-4093-4b83-95b0-66f9d4d86a6a tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:00.885005 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4e251c37-4093-4b83-95b0-66f9d4d86a6a tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:00.885445 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4e251c37-4093-4b83-95b0-66f9d4d86a6a tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:00.886242 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4e251c37-4093-4b83-95b0-66f9d4d86a6a tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:00.886670 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4e251c37-4093-4b83-95b0-66f9d4d86a6a tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:01.038671 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4e251c37-4093-4b83-95b0-66f9d4d86a6a tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:01.046675 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4e251c37-4093-4b83-95b0-66f9d4d86a6a tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1573 microversion: 2.1 time: 0.173322 Dec 15 13:13:01.047315 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 684/1305] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:00 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1573 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:13:02.066374 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-05fd04a9-0393-4331-a38b-4e70770ccd17 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:02.066985 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-05fd04a9-0393-4331-a38b-4e70770ccd17 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:02.073164 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-05fd04a9-0393-4331-a38b-4e70770ccd17 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:02.073613 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-05fd04a9-0393-4331-a38b-4e70770ccd17 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:02.074408 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-05fd04a9-0393-4331-a38b-4e70770ccd17 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:02.074849 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-05fd04a9-0393-4331-a38b-4e70770ccd17 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:02.220830 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-05fd04a9-0393-4331-a38b-4e70770ccd17 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:02.228496 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-05fd04a9-0393-4331-a38b-4e70770ccd17 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1573 microversion: 2.1 time: 0.165767 Dec 15 13:13:02.229067 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 622/1306] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:02 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:13:03.249362 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b9e7a748-ec56-41cd-b76d-44f6dfe7a9cd tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:03.249971 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b9e7a748-ec56-41cd-b76d-44f6dfe7a9cd tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:03.256357 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b9e7a748-ec56-41cd-b76d-44f6dfe7a9cd tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:03.256803 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b9e7a748-ec56-41cd-b76d-44f6dfe7a9cd tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:03.257565 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b9e7a748-ec56-41cd-b76d-44f6dfe7a9cd tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:03.257992 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b9e7a748-ec56-41cd-b76d-44f6dfe7a9cd tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:03.407966 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b9e7a748-ec56-41cd-b76d-44f6dfe7a9cd tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:03.416227 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b9e7a748-ec56-41cd-b76d-44f6dfe7a9cd tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1573 microversion: 2.1 time: 0.170201 Dec 15 13:13:03.416807 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 685/1307] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:03 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1573 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:13:04.434451 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-c9d468ab-0668-4d5c-84aa-6243342cbf20 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:04.435445 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-c9d468ab-0668-4d5c-84aa-6243342cbf20 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:04.442989 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c9d468ab-0668-4d5c-84aa-6243342cbf20 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:04.443460 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c9d468ab-0668-4d5c-84aa-6243342cbf20 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:04.444242 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c9d468ab-0668-4d5c-84aa-6243342cbf20 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:04.444678 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c9d468ab-0668-4d5c-84aa-6243342cbf20 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:04.577130 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-c9d468ab-0668-4d5c-84aa-6243342cbf20 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:04.588055 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-c9d468ab-0668-4d5c-84aa-6243342cbf20 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1573 microversion: 2.1 time: 0.157123 Dec 15 13:13:04.588620 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 623/1308] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:04 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:13:05.606291 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9a34736b-798e-4e67-9f68-b141fe51c1cf tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:05.607101 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9a34736b-798e-4e67-9f68-b141fe51c1cf tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:05.614076 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9a34736b-798e-4e67-9f68-b141fe51c1cf tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:05.614557 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9a34736b-798e-4e67-9f68-b141fe51c1cf tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:05.615344 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9a34736b-798e-4e67-9f68-b141fe51c1cf tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:05.615779 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9a34736b-798e-4e67-9f68-b141fe51c1cf tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:05.758134 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-9a34736b-798e-4e67-9f68-b141fe51c1cf tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:05.768651 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9a34736b-798e-4e67-9f68-b141fe51c1cf tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1573 microversion: 2.1 time: 0.166655 Dec 15 13:13:05.769530 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 686/1309] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:05 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1573 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:13:06.790936 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-8a32445a-4ce2-4322-97d4-40abda7c3cf3 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:06.791919 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-8a32445a-4ce2-4322-97d4-40abda7c3cf3 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:06.798473 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8a32445a-4ce2-4322-97d4-40abda7c3cf3 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:06.799019 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8a32445a-4ce2-4322-97d4-40abda7c3cf3 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:06.799914 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8a32445a-4ce2-4322-97d4-40abda7c3cf3 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:06.800441 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8a32445a-4ce2-4322-97d4-40abda7c3cf3 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:07.032227 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-8a32445a-4ce2-4322-97d4-40abda7c3cf3 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:07.040629 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-8a32445a-4ce2-4322-97d4-40abda7c3cf3 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1573 microversion: 2.1 time: 0.253708 Dec 15 13:13:07.041271 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 624/1310] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:06 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1573 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:13:08.061158 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8963bb68-5902-4dd6-80d8-eee1db688afa tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:08.061860 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8963bb68-5902-4dd6-80d8-eee1db688afa tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:08.070459 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8963bb68-5902-4dd6-80d8-eee1db688afa tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:08.070995 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8963bb68-5902-4dd6-80d8-eee1db688afa tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:08.071876 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8963bb68-5902-4dd6-80d8-eee1db688afa tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:08.072329 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8963bb68-5902-4dd6-80d8-eee1db688afa tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:08.224043 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8963bb68-5902-4dd6-80d8-eee1db688afa tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:08.231492 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8963bb68-5902-4dd6-80d8-eee1db688afa tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1560 microversion: 2.1 time: 0.176286 Dec 15 13:13:08.232131 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 687/1311] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:08 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:13:09.732040 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-b2b10d8c-19ef-4c37-98f5-7bbfcd7387c6 req-5598a124-b308-4690-8d63-9340df47fd85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "619e3772-5547-4f07-b126-5b6482ad8749", "name": "network-vif-plugged", "status": "completed", "tag": "22db1fdd-c799-4ae9-bc07-611872cd4207"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:13:09.736424 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:13:09.736424 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:13:09.751320 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-b2b10d8c-19ef-4c37-98f5-7bbfcd7387c6 req-5598a124-b308-4690-8d63-9340df47fd85 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:09.752774 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-b2b10d8c-19ef-4c37-98f5-7bbfcd7387c6 req-5598a124-b308-4690-8d63-9340df47fd85 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:09.770436 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-b2b10d8c-19ef-4c37-98f5-7bbfcd7387c6 req-5598a124-b308-4690-8d63-9340df47fd85 service nova] Creating event network-vif-plugged:22db1fdd-c799-4ae9-bc07-611872cd4207 for instance 619e3772-5547-4f07-b126-5b6482ad8749 on hv-cinder-81322 Dec 15 13:13:09.780650 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-b2b10d8c-19ef-4c37-98f5-7bbfcd7387c6 req-5598a124-b308-4690-8d63-9340df47fd85 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056943 Dec 15 13:13:09.782955 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 625/1312] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:13:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:13:47.685991 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4da20325-d1d6-4668-b5ca-e68c46251e79 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:47.686737 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4da20325-d1d6-4668-b5ca-e68c46251e79 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: b14ea93a-eff2-476e-9a50-8352bfa100f9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:47.692499 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4da20325-d1d6-4668-b5ca-e68c46251e79 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:47.692943 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4da20325-d1d6-4668-b5ca-e68c46251e79 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:47.693722 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4da20325-d1d6-4668-b5ca-e68c46251e79 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:47.694174 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4da20325-d1d6-4668-b5ca-e68c46251e79 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:47.718079 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4da20325-d1d6-4668-b5ca-e68c46251e79 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: b14ea93a-eff2-476e-9a50-8352bfa100f9] Going to try to terminate instance {{(pid=116098) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:13:47.791975 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4da20325-d1d6-4668-b5ca-e68c46251e79 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9" status: 204 len: 0 microversion: 2.1 time: 0.109691 Dec 15 13:13:47.792565 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 688/1313] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Dec 15 13:13:47 2021] DELETE /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:13:47.802742 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-d30e6e5c-32c4-495c-a99f-52f42790fc3a tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:47.803450 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-d30e6e5c-32c4-495c-a99f-52f42790fc3a tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: b14ea93a-eff2-476e-9a50-8352bfa100f9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:47.809606 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d30e6e5c-32c4-495c-a99f-52f42790fc3a tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:47.810053 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d30e6e5c-32c4-495c-a99f-52f42790fc3a tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:47.810862 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d30e6e5c-32c4-495c-a99f-52f42790fc3a tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:47.811298 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d30e6e5c-32c4-495c-a99f-52f42790fc3a tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:47.953110 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-d30e6e5c-32c4-495c-a99f-52f42790fc3a tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:47.960652 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-d30e6e5c-32c4-495c-a99f-52f42790fc3a tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9" status: 200 len: 1577 microversion: 2.1 time: 0.163296 Dec 15 13:13:47.961229 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 626/1314] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:47 2021] GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:13:48.979085 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-2e2733ea-45f8-44cd-9684-16a4f3214b78 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:48.979781 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-2e2733ea-45f8-44cd-9684-16a4f3214b78 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: b14ea93a-eff2-476e-9a50-8352bfa100f9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:48.986613 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2e2733ea-45f8-44cd-9684-16a4f3214b78 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:48.987058 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2e2733ea-45f8-44cd-9684-16a4f3214b78 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:48.987833 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2e2733ea-45f8-44cd-9684-16a4f3214b78 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:48.988268 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2e2733ea-45f8-44cd-9684-16a4f3214b78 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:49.152060 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-2e2733ea-45f8-44cd-9684-16a4f3214b78 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:49.160932 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-2e2733ea-45f8-44cd-9684-16a4f3214b78 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9" status: 200 len: 1577 microversion: 2.1 time: 0.185914 Dec 15 13:13:49.161499 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 689/1315] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:48 2021] GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9 => generated 1577 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:13:50.178213 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-a9280e59-a292-4bad-b149-7261f5f45b4a tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:50.178834 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-a9280e59-a292-4bad-b149-7261f5f45b4a tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: b14ea93a-eff2-476e-9a50-8352bfa100f9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:50.184885 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a9280e59-a292-4bad-b149-7261f5f45b4a tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:50.185336 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a9280e59-a292-4bad-b149-7261f5f45b4a tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:50.186123 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a9280e59-a292-4bad-b149-7261f5f45b4a tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:50.186585 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-a9280e59-a292-4bad-b149-7261f5f45b4a tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:50.214600 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-f924553d-4b5d-469e-afed-2d2814f63675 req-3e646fae-b453-4000-ad8a-086678c787e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b14ea93a-eff2-476e-9a50-8352bfa100f9", "name": "network-vif-deleted", "tag": "0d76c703-26be-4464-bcdf-c6f7e1de4cf3"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:13:50.216234 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:13:50.216234 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:13:50.228056 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-f924553d-4b5d-469e-afed-2d2814f63675 req-3e646fae-b453-4000-ad8a-086678c787e3 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:50.228409 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-f924553d-4b5d-469e-afed-2d2814f63675 req-3e646fae-b453-4000-ad8a-086678c787e3 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:50.241990 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-f924553d-4b5d-469e-afed-2d2814f63675 req-3e646fae-b453-4000-ad8a-086678c787e3 service nova] Creating event network-vif-deleted:0d76c703-26be-4464-bcdf-c6f7e1de4cf3 for instance b14ea93a-eff2-476e-9a50-8352bfa100f9 on hv-cinder-81322 Dec 15 13:13:50.248072 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-f924553d-4b5d-469e-afed-2d2814f63675 req-3e646fae-b453-4000-ad8a-086678c787e3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036869 Dec 15 13:13:50.249355 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 690/1316] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:13:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:13:50.282966 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-a9280e59-a292-4bad-b149-7261f5f45b4a tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:50.292152 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-a9280e59-a292-4bad-b149-7261f5f45b4a tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9" status: 200 len: 1509 microversion: 2.1 time: 0.118177 Dec 15 13:13:50.292738 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 627/1317] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:50 2021] GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9 => generated 1509 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:13:51.310824 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a6c47771-ebc7-43c1-8230-ac232648d506 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:51.311522 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a6c47771-ebc7-43c1-8230-ac232648d506 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: b14ea93a-eff2-476e-9a50-8352bfa100f9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:51.320248 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a6c47771-ebc7-43c1-8230-ac232648d506 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:51.320675 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a6c47771-ebc7-43c1-8230-ac232648d506 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:51.321886 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a6c47771-ebc7-43c1-8230-ac232648d506 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:51.322533 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a6c47771-ebc7-43c1-8230-ac232648d506 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:51.336712 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-a6c47771-ebc7-43c1-8230-ac232648d506 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] HTTP exception thrown: Instance b14ea93a-eff2-476e-9a50-8352bfa100f9 could not be found. Dec 15 13:13:51.337292 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a6c47771-ebc7-43c1-8230-ac232648d506 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Returning 404 to user: Instance b14ea93a-eff2-476e-9a50-8352bfa100f9 could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:13:51.338231 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a6c47771-ebc7-43c1-8230-ac232648d506 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9" status: 404 len: 111 microversion: 2.1 time: 0.032085 Dec 15 13:13:51.338789 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 691/1318] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:51 2021] GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:13:51.441975 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-9650fe69-7d2f-47e9-8525-65348447ca57 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-10530049", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-763252721", "security_groups": [{"name": "tempest-secgroup-smoke-1611347591"}], "block_device_mapping_v2": [{"uuid": "a626e19c-20a0-49cf-a302-8d123b2a6f84", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5eab384c-36ea-4de9-9630-bc1a7d6a1dac"}]}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:13:51.566832 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.network.neutron [None req-9650fe69-7d2f-47e9-8525-65348447ca57 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] validate_networks() for [('5eab384c-36ea-4de9-9630-bc1a7d6a1dac', None, None, None, None, None)] {{(pid=116097) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:13:52.005514 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-9650fe69-7d2f-47e9-8525-65348447ca57 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Flavor limits 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:13:52.005930 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-9650fe69-7d2f-47e9-8525-65348447ca57 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Image limits 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:13:52.006442 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-9650fe69-7d2f-47e9-8525-65348447ca57 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Flavor pref 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:13:52.006851 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-9650fe69-7d2f-47e9-8525-65348447ca57 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Image pref 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:13:52.007256 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-9650fe69-7d2f-47e9-8525-65348447ca57 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:13:52.015808 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9650fe69-7d2f-47e9-8525-65348447ca57 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:52.016245 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9650fe69-7d2f-47e9-8525-65348447ca57 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:52.017592 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9650fe69-7d2f-47e9-8525-65348447ca57 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:52.018025 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-9650fe69-7d2f-47e9-8525-65348447ca57 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:52.034460 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-9650fe69-7d2f-47e9-8525-65348447ca57 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Getting quotas for project 85b5372522d64067b34faa325b4dc400. Resources: {'instances', 'cores', 'ram'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:13:52.038269 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-9650fe69-7d2f-47e9-8525-65348447ca57 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Getting quotas for user 913f4595b6444821801332dacab3c616 and project 85b5372522d64067b34faa325b4dc400. Resources: {'instances', 'cores', 'ram'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:13:52.091642 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-9650fe69-7d2f-47e9-8525-65348447ca57 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Going to run 1 instances... {{(pid=116097) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:13:52.093826 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-9650fe69-7d2f-47e9-8525-65348447ca57 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: 6015b216-5022-4672-a69b-fc2e3bd8734f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a626e19c-20a0-49cf-a302-8d123b2a6f84',volume_size=None,volume_type=None)] {{(pid=116097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:13:52.217151 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-9650fe69-7d2f-47e9-8525-65348447ca57 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.779472 Dec 15 13:13:52.217791 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 628/1319] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Dec 15 13:13:51 2021] POST /compute/v2.1/servers => generated 406 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:13:52.227554 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1b6a1f95-05e3-4d03-a0aa-51ea76874ded tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:52.228166 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1b6a1f95-05e3-4d03-a0aa-51ea76874ded tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: 6015b216-5022-4672-a69b-fc2e3bd8734f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:52.283389 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1b6a1f95-05e3-4d03-a0aa-51ea76874ded tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:52.289962 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1b6a1f95-05e3-4d03-a0aa-51ea76874ded tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f" status: 200 len: 1092 microversion: 2.1 time: 0.066042 Dec 15 13:13:52.290561 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 692/1320] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:52 2021] GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f => generated 1092 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:13:53.306789 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-8c04e82d-bf86-4c0f-bcf3-fe429f6ec170 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:53.307432 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-8c04e82d-bf86-4c0f-bcf3-fe429f6ec170 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: 6015b216-5022-4672-a69b-fc2e3bd8734f] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:53.313367 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8c04e82d-bf86-4c0f-bcf3-fe429f6ec170 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:53.313861 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8c04e82d-bf86-4c0f-bcf3-fe429f6ec170 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:53.314866 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8c04e82d-bf86-4c0f-bcf3-fe429f6ec170 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:53.315482 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-8c04e82d-bf86-4c0f-bcf3-fe429f6ec170 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:53.388156 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-8c04e82d-bf86-4c0f-bcf3-fe429f6ec170 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:53.396314 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-8c04e82d-bf86-4c0f-bcf3-fe429f6ec170 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f" status: 200 len: 1208 microversion: 2.1 time: 0.093382 Dec 15 13:13:53.396873 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 629/1321] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:53 2021] GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f => generated 1208 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:13:54.416186 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0ad80d77-105f-4130-b225-95cd0065ef18 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:54.417570 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0ad80d77-105f-4130-b225-95cd0065ef18 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: 6015b216-5022-4672-a69b-fc2e3bd8734f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:54.427781 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0ad80d77-105f-4130-b225-95cd0065ef18 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:54.428459 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0ad80d77-105f-4130-b225-95cd0065ef18 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:54.429444 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0ad80d77-105f-4130-b225-95cd0065ef18 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:54.429927 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0ad80d77-105f-4130-b225-95cd0065ef18 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:54.465192 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-0ef3cc18-694d-4b3a-a8fe-1095af12ec8f req-9032c9de-b82f-4175-9307-25aeb4807681 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6015b216-5022-4672-a69b-fc2e3bd8734f", "tag": "c87b005e-ad36-475c-a467-08a5c29fea89"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:13:54.468314 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:13:54.468314 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:13:54.480767 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-0ef3cc18-694d-4b3a-a8fe-1095af12ec8f req-9032c9de-b82f-4175-9307-25aeb4807681 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:54.481323 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-0ef3cc18-694d-4b3a-a8fe-1095af12ec8f req-9032c9de-b82f-4175-9307-25aeb4807681 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:54.495235 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-0ef3cc18-694d-4b3a-a8fe-1095af12ec8f req-9032c9de-b82f-4175-9307-25aeb4807681 service nova] Creating event network-changed:c87b005e-ad36-475c-a467-08a5c29fea89 for instance 6015b216-5022-4672-a69b-fc2e3bd8734f on hv-cinder-81322 Dec 15 13:13:54.500705 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-0ef3cc18-694d-4b3a-a8fe-1095af12ec8f req-9032c9de-b82f-4175-9307-25aeb4807681 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038996 Dec 15 13:13:54.501853 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 630/1322] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:13:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:13:54.589185 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0ad80d77-105f-4130-b225-95cd0065ef18 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:54.597224 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-0ad80d77-105f-4130-b225-95cd0065ef18 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f" status: 200 len: 1264 microversion: 2.1 time: 0.186317 Dec 15 13:13:54.597802 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 693/1323] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:54 2021] GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f => generated 1264 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:13:55.615334 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-1f868776-8f67-4f6c-abf0-2828046bc060 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:55.615926 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-1f868776-8f67-4f6c-abf0-2828046bc060 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: 6015b216-5022-4672-a69b-fc2e3bd8734f] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:55.623195 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1f868776-8f67-4f6c-abf0-2828046bc060 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:55.623649 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1f868776-8f67-4f6c-abf0-2828046bc060 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:55.624441 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1f868776-8f67-4f6c-abf0-2828046bc060 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:55.624880 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1f868776-8f67-4f6c-abf0-2828046bc060 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:55.762881 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-1f868776-8f67-4f6c-abf0-2828046bc060 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:55.770414 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-1f868776-8f67-4f6c-abf0-2828046bc060 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f" status: 200 len: 1264 microversion: 2.1 time: 0.160062 Dec 15 13:13:55.770976 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 631/1324] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:55 2021] GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:13:56.786656 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b18cbb32-19b4-4dd2-b524-f67f8dce6ad7 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:56.787376 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b18cbb32-19b4-4dd2-b524-f67f8dce6ad7 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: 6015b216-5022-4672-a69b-fc2e3bd8734f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:56.793646 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b18cbb32-19b4-4dd2-b524-f67f8dce6ad7 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:56.794094 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b18cbb32-19b4-4dd2-b524-f67f8dce6ad7 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:56.794895 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b18cbb32-19b4-4dd2-b524-f67f8dce6ad7 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:56.795332 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b18cbb32-19b4-4dd2-b524-f67f8dce6ad7 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:57.083986 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b18cbb32-19b4-4dd2-b524-f67f8dce6ad7 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:57.091290 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b18cbb32-19b4-4dd2-b524-f67f8dce6ad7 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f" status: 200 len: 1264 microversion: 2.1 time: 0.308327 Dec 15 13:13:57.091847 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 694/1325] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:56 2021] GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f => generated 1264 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:13:58.108151 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-df57f37e-79ee-4d95-acc4-ba2a2478767f tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:58.108852 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-df57f37e-79ee-4d95-acc4-ba2a2478767f tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: 6015b216-5022-4672-a69b-fc2e3bd8734f] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:58.114943 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-df57f37e-79ee-4d95-acc4-ba2a2478767f tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:58.115390 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-df57f37e-79ee-4d95-acc4-ba2a2478767f tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:58.116161 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-df57f37e-79ee-4d95-acc4-ba2a2478767f tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:58.116589 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-df57f37e-79ee-4d95-acc4-ba2a2478767f tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:58.305858 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-df57f37e-79ee-4d95-acc4-ba2a2478767f tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:58.313607 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-df57f37e-79ee-4d95-acc4-ba2a2478767f tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f" status: 200 len: 1264 microversion: 2.1 time: 0.208714 Dec 15 13:13:58.314194 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 632/1326] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:58 2021] GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f => generated 1264 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:13:59.332527 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9f905991-976b-42d0-9666-98caaa22e1aa tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:59.333133 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9f905991-976b-42d0-9666-98caaa22e1aa tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: 6015b216-5022-4672-a69b-fc2e3bd8734f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:59.339506 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9f905991-976b-42d0-9666-98caaa22e1aa tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:59.339950 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9f905991-976b-42d0-9666-98caaa22e1aa tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:59.340719 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9f905991-976b-42d0-9666-98caaa22e1aa tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:59.341152 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9f905991-976b-42d0-9666-98caaa22e1aa tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:59.478520 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-9f905991-976b-42d0-9666-98caaa22e1aa tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:59.485689 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9f905991-976b-42d0-9666-98caaa22e1aa tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f" status: 200 len: 1264 microversion: 2.1 time: 0.157344 Dec 15 13:13:59.486289 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 695/1327] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:59 2021] GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:00.506904 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-e510c2a5-96b2-4863-b9ea-b525b101dbb7 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:00.507555 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-e510c2a5-96b2-4863-b9ea-b525b101dbb7 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: 6015b216-5022-4672-a69b-fc2e3bd8734f] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:00.514012 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e510c2a5-96b2-4863-b9ea-b525b101dbb7 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:00.514514 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e510c2a5-96b2-4863-b9ea-b525b101dbb7 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:00.515318 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e510c2a5-96b2-4863-b9ea-b525b101dbb7 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:00.515752 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-e510c2a5-96b2-4863-b9ea-b525b101dbb7 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:00.654055 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-e510c2a5-96b2-4863-b9ea-b525b101dbb7 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:00.661949 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-e510c2a5-96b2-4863-b9ea-b525b101dbb7 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f" status: 200 len: 1264 microversion: 2.1 time: 0.163572 Dec 15 13:14:00.662542 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 633/1328] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:00 2021] GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:01.678709 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a17db8ef-85fc-4c49-b66a-a043f6417d40 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:01.679393 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a17db8ef-85fc-4c49-b66a-a043f6417d40 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: 6015b216-5022-4672-a69b-fc2e3bd8734f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:01.685955 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a17db8ef-85fc-4c49-b66a-a043f6417d40 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:01.686423 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a17db8ef-85fc-4c49-b66a-a043f6417d40 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:01.687200 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a17db8ef-85fc-4c49-b66a-a043f6417d40 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:01.687625 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a17db8ef-85fc-4c49-b66a-a043f6417d40 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:01.824852 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a17db8ef-85fc-4c49-b66a-a043f6417d40 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:01.834373 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a17db8ef-85fc-4c49-b66a-a043f6417d40 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f" status: 200 len: 1264 microversion: 2.1 time: 0.159291 Dec 15 13:14:01.834959 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 696/1329] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:01 2021] GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:14:02.851365 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-bf9a5717-911a-4299-970f-8abada4ecabe tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:02.852000 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-bf9a5717-911a-4299-970f-8abada4ecabe tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: 6015b216-5022-4672-a69b-fc2e3bd8734f] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:02.858322 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-bf9a5717-911a-4299-970f-8abada4ecabe tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:02.858779 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-bf9a5717-911a-4299-970f-8abada4ecabe tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:02.859593 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-bf9a5717-911a-4299-970f-8abada4ecabe tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:02.860051 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-bf9a5717-911a-4299-970f-8abada4ecabe tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:03.000224 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-bf9a5717-911a-4299-970f-8abada4ecabe tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:03.008743 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-bf9a5717-911a-4299-970f-8abada4ecabe tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f" status: 200 len: 1264 microversion: 2.1 time: 0.161148 Dec 15 13:14:03.009303 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 634/1330] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:02 2021] GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:03.968337 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-117eb901-c05b-4960-ad55-46c842e4c6f3 req-e25450d0-10af-46b3-b375-07e9ef34e9d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6015b216-5022-4672-a69b-fc2e3bd8734f", "name": "network-vif-plugged", "status": "completed", "tag": "c87b005e-ad36-475c-a467-08a5c29fea89"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:14:03.970429 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:14:03.970429 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:14:03.980095 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-117eb901-c05b-4960-ad55-46c842e4c6f3 req-e25450d0-10af-46b3-b375-07e9ef34e9d5 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:03.980546 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-117eb901-c05b-4960-ad55-46c842e4c6f3 req-e25450d0-10af-46b3-b375-07e9ef34e9d5 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:03.999046 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-117eb901-c05b-4960-ad55-46c842e4c6f3 req-e25450d0-10af-46b3-b375-07e9ef34e9d5 service nova] Creating event network-vif-plugged:c87b005e-ad36-475c-a467-08a5c29fea89 for instance 6015b216-5022-4672-a69b-fc2e3bd8734f on hv-cinder-81322 Dec 15 13:14:04.008269 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-117eb901-c05b-4960-ad55-46c842e4c6f3 req-e25450d0-10af-46b3-b375-07e9ef34e9d5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043314 Dec 15 13:14:04.009364 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 697/1331] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:14:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:14:04.024775 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-74f3ff7d-a92b-4a79-ab54-93cda0bfb980 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:04.026051 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-74f3ff7d-a92b-4a79-ab54-93cda0bfb980 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: 6015b216-5022-4672-a69b-fc2e3bd8734f] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:04.033714 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-74f3ff7d-a92b-4a79-ab54-93cda0bfb980 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:04.034321 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-74f3ff7d-a92b-4a79-ab54-93cda0bfb980 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:04.035188 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-74f3ff7d-a92b-4a79-ab54-93cda0bfb980 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:04.035691 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-74f3ff7d-a92b-4a79-ab54-93cda0bfb980 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:04.182341 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-74f3ff7d-a92b-4a79-ab54-93cda0bfb980 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:04.191473 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-74f3ff7d-a92b-4a79-ab54-93cda0bfb980 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f" status: 200 len: 1264 microversion: 2.1 time: 0.170514 Dec 15 13:14:04.192050 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 635/1332] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:04 2021] GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:05.209041 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-08315e77-941d-48b8-8a9a-4d6daab466e7 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:05.209853 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-08315e77-941d-48b8-8a9a-4d6daab466e7 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: 6015b216-5022-4672-a69b-fc2e3bd8734f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:05.216156 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-08315e77-941d-48b8-8a9a-4d6daab466e7 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:05.216603 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-08315e77-941d-48b8-8a9a-4d6daab466e7 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:05.217466 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-08315e77-941d-48b8-8a9a-4d6daab466e7 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:05.217901 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-08315e77-941d-48b8-8a9a-4d6daab466e7 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:05.366840 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-08315e77-941d-48b8-8a9a-4d6daab466e7 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:05.374384 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-08315e77-941d-48b8-8a9a-4d6daab466e7 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f" status: 200 len: 1264 microversion: 2.1 time: 0.169776 Dec 15 13:14:05.374949 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 698/1333] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:05 2021] GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:05.705471 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:14:05.706107 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: Wed Dec 15 13:14:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:14:06.391990 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-c940acf8-13ee-4a53-b15e-be56a61609b8 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:06.392596 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-c940acf8-13ee-4a53-b15e-be56a61609b8 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: 6015b216-5022-4672-a69b-fc2e3bd8734f] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:06.400031 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c940acf8-13ee-4a53-b15e-be56a61609b8 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:06.400482 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c940acf8-13ee-4a53-b15e-be56a61609b8 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:06.401267 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c940acf8-13ee-4a53-b15e-be56a61609b8 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:06.401700 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-c940acf8-13ee-4a53-b15e-be56a61609b8 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:06.538039 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-c940acf8-13ee-4a53-b15e-be56a61609b8 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:06.545533 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-c940acf8-13ee-4a53-b15e-be56a61609b8 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f" status: 200 len: 1450 microversion: 2.1 time: 0.157799 Dec 15 13:14:06.546088 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 636/1334] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:06 2021] GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:06.561999 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-3b623b15-bd0d-4ead-80ff-2d0429fd03c0 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:06.562663 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-3b623b15-bd0d-4ead-80ff-2d0429fd03c0 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: 6015b216-5022-4672-a69b-fc2e3bd8734f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:06.568995 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3b623b15-bd0d-4ead-80ff-2d0429fd03c0 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:06.569437 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3b623b15-bd0d-4ead-80ff-2d0429fd03c0 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:06.570242 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3b623b15-bd0d-4ead-80ff-2d0429fd03c0 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:06.570674 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3b623b15-bd0d-4ead-80ff-2d0429fd03c0 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:06.708368 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-3b623b15-bd0d-4ead-80ff-2d0429fd03c0 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:06.715625 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-3b623b15-bd0d-4ead-80ff-2d0429fd03c0 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f" status: 200 len: 1450 microversion: 2.1 time: 0.157315 Dec 15 13:14:06.716182 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 699/1335] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:06 2021] GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:08.305739 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-ee98796e-6b6b-422e-a68f-86a754c20959 req-513dc9e9-11c6-40a4-9d2b-c8cbdff3b562 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6015b216-5022-4672-a69b-fc2e3bd8734f", "tag": "c87b005e-ad36-475c-a467-08a5c29fea89"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:14:08.307333 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:14:08.307333 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:14:08.315434 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-ee98796e-6b6b-422e-a68f-86a754c20959 req-513dc9e9-11c6-40a4-9d2b-c8cbdff3b562 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:08.315851 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-ee98796e-6b6b-422e-a68f-86a754c20959 req-513dc9e9-11c6-40a4-9d2b-c8cbdff3b562 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:08.327171 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-ee98796e-6b6b-422e-a68f-86a754c20959 req-513dc9e9-11c6-40a4-9d2b-c8cbdff3b562 service nova] Creating event network-changed:c87b005e-ad36-475c-a467-08a5c29fea89 for instance 6015b216-5022-4672-a69b-fc2e3bd8734f on hv-cinder-81322 Dec 15 13:14:08.332710 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-ee98796e-6b6b-422e-a68f-86a754c20959 req-513dc9e9-11c6-40a4-9d2b-c8cbdff3b562 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030602 Dec 15 13:14:08.333331 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 637/1336] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:14:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:14:22.047427 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-04bbf3a8-ddca-43c2-be5b-7c5247c0a7c3 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:22.047984 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-04bbf3a8-ddca-43c2-be5b-7c5247c0a7c3 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:22.063062 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-04bbf3a8-ddca-43c2-be5b-7c5247c0a7c3 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:22.063062 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-04bbf3a8-ddca-43c2-be5b-7c5247c0a7c3 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:22.063062 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-04bbf3a8-ddca-43c2-be5b-7c5247c0a7c3 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:22.063426 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-04bbf3a8-ddca-43c2-be5b-7c5247c0a7c3 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:22.089514 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-04bbf3a8-ddca-43c2-be5b-7c5247c0a7c3 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Going to try to terminate instance {{(pid=116098) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:14:22.115903 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-92a41532-b302-47ba-abd9-9851ba1fb0b5 req-2ffc4644-dc1d-4795-8263-35221092a541 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "619e3772-5547-4f07-b126-5b6482ad8749", "tag": "22db1fdd-c799-4ae9-bc07-611872cd4207"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:14:22.117406 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:14:22.117406 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:14:22.129420 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-92a41532-b302-47ba-abd9-9851ba1fb0b5 req-2ffc4644-dc1d-4795-8263-35221092a541 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:22.130281 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-92a41532-b302-47ba-abd9-9851ba1fb0b5 req-2ffc4644-dc1d-4795-8263-35221092a541 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:22.143020 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-92a41532-b302-47ba-abd9-9851ba1fb0b5 req-2ffc4644-dc1d-4795-8263-35221092a541 service nova] Creating event network-changed:22db1fdd-c799-4ae9-bc07-611872cd4207 for instance 619e3772-5547-4f07-b126-5b6482ad8749 on hv-cinder-81322 Dec 15 13:14:22.148552 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-92a41532-b302-47ba-abd9-9851ba1fb0b5 req-2ffc4644-dc1d-4795-8263-35221092a541 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096787 Dec 15 13:14:22.149145 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 638/1337] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:14:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:14:22.176710 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-04bbf3a8-ddca-43c2-be5b-7c5247c0a7c3 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "DELETE /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 204 len: 0 microversion: 2.1 time: 0.132553 Dec 15 13:14:22.177390 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 700/1338] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Dec 15 13:14:22 2021] DELETE /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:14:22.192558 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-cda5bac6-3adf-4d4b-907e-19f45cf219f7 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:22.193760 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-cda5bac6-3adf-4d4b-907e-19f45cf219f7 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:22.204887 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cda5bac6-3adf-4d4b-907e-19f45cf219f7 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:22.205655 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cda5bac6-3adf-4d4b-907e-19f45cf219f7 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:22.206983 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cda5bac6-3adf-4d4b-907e-19f45cf219f7 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:22.207735 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-cda5bac6-3adf-4d4b-907e-19f45cf219f7 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:22.445632 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-cda5bac6-3adf-4d4b-907e-19f45cf219f7 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:22.455166 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-cda5bac6-3adf-4d4b-907e-19f45cf219f7 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1566 microversion: 2.1 time: 0.270763 Dec 15 13:14:22.455896 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 639/1339] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:22 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1566 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:23.473862 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d050b727-c43d-483d-a88a-4ff227718ffb tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:23.474590 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d050b727-c43d-483d-a88a-4ff227718ffb tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:23.480740 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d050b727-c43d-483d-a88a-4ff227718ffb tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:23.481183 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d050b727-c43d-483d-a88a-4ff227718ffb tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:23.481941 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d050b727-c43d-483d-a88a-4ff227718ffb tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:23.482391 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d050b727-c43d-483d-a88a-4ff227718ffb tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:23.616447 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d050b727-c43d-483d-a88a-4ff227718ffb tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:23.624307 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d050b727-c43d-483d-a88a-4ff227718ffb tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1447 microversion: 2.1 time: 0.153919 Dec 15 13:14:23.625275 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 701/1340] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:23 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1447 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:23.676422 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:14:23.676675 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: Wed Dec 15 13:14:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:14:24.355269 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-237d378d-f545-45e3-ae60-daac49b3a245 req-890ad9ce-517c-4636-aff3-acdf1e81335e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "619e3772-5547-4f07-b126-5b6482ad8749", "name": "network-vif-deleted", "tag": "22db1fdd-c799-4ae9-bc07-611872cd4207"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:14:24.357402 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:14:24.357402 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:14:24.365595 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-237d378d-f545-45e3-ae60-daac49b3a245 req-890ad9ce-517c-4636-aff3-acdf1e81335e service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:24.366250 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-237d378d-f545-45e3-ae60-daac49b3a245 req-890ad9ce-517c-4636-aff3-acdf1e81335e service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:24.382691 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-237d378d-f545-45e3-ae60-daac49b3a245 req-890ad9ce-517c-4636-aff3-acdf1e81335e service nova] Creating event network-vif-deleted:22db1fdd-c799-4ae9-bc07-611872cd4207 for instance 619e3772-5547-4f07-b126-5b6482ad8749 on hv-cinder-81322 Dec 15 13:14:24.391299 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-237d378d-f545-45e3-ae60-daac49b3a245 req-890ad9ce-517c-4636-aff3-acdf1e81335e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037073 Dec 15 13:14:24.391299 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 640/1341] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:14:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:14:24.644272 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-45ec2dd2-813f-49f3-817f-d0df363850f6 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:24.644999 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-45ec2dd2-813f-49f3-817f-d0df363850f6 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:24.651733 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-45ec2dd2-813f-49f3-817f-d0df363850f6 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:24.652573 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-45ec2dd2-813f-49f3-817f-d0df363850f6 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:24.653457 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-45ec2dd2-813f-49f3-817f-d0df363850f6 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:24.653939 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-45ec2dd2-813f-49f3-817f-d0df363850f6 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:24.724454 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-45ec2dd2-813f-49f3-817f-d0df363850f6 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53181e8b308404185e2c38749ee619b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6505d138c547538566bf960f213d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:24.733026 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-45ec2dd2-813f-49f3-817f-d0df363850f6 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 200 len: 1220 microversion: 2.1 time: 0.092393 Dec 15 13:14:24.734407 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 702/1342] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:24 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:25.751186 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-00634425-4ec1-4347-bea6-f549f151d7ef tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:25.751874 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-00634425-4ec1-4347-bea6-f549f151d7ef tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] [instance: 619e3772-5547-4f07-b126-5b6482ad8749] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:25.757912 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-00634425-4ec1-4347-bea6-f549f151d7ef tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:25.758401 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-00634425-4ec1-4347-bea6-f549f151d7ef tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:25.759176 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-00634425-4ec1-4347-bea6-f549f151d7ef tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:25.759610 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-00634425-4ec1-4347-bea6-f549f151d7ef tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:25.772645 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.wsgi [None req-00634425-4ec1-4347-bea6-f549f151d7ef tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] HTTP exception thrown: Instance 619e3772-5547-4f07-b126-5b6482ad8749 could not be found. Dec 15 13:14:25.773213 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-00634425-4ec1-4347-bea6-f549f151d7ef tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Returning 404 to user: Instance 619e3772-5547-4f07-b126-5b6482ad8749 could not be found. {{(pid=116097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:14:25.774015 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-00634425-4ec1-4347-bea6-f549f151d7ef tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749" status: 404 len: 111 microversion: 2.1 time: 0.027619 Dec 15 13:14:25.774552 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 641/1343] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:25 2021] GET /compute/v2.1/servers/619e3772-5547-4f07-b126-5b6482ad8749 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:14:25.926596 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-535560cf-e056-402e-85af-bbe060e0a8e4 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] Calling method '.version_select at 0x7faf1809ec10>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:25.948679 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-535560cf-e056-402e-85af-bbe060e0a8e4 tempest-TestShelveInstance-2116209645 tempest-TestShelveInstance-2116209645-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1186721875" status: 202 len: 0 microversion: 2.1 time: 0.025511 Dec 15 13:14:25.949122 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 703/1344] 10.222.0.57 () {58 vars in 1253 bytes} [Wed Dec 15 13:14:25 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1186721875 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:15:41.693247 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:15:41.693962 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: Wed Dec 15 13:15:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:15:46.059512 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-d0093cf4-3307-4e39-aac3-e33eef6e9900 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-225441248", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-763252721", "security_groups": [{"name": "tempest-secgroup-smoke-1611347591"}], "block_device_mapping_v2": [{"uuid": "c6082279-1e5a-4162-ad68-e0fb51920461", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5eab384c-36ea-4de9-9630-bc1a7d6a1dac"}]}} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:15:46.169848 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.network.neutron [None req-d0093cf4-3307-4e39-aac3-e33eef6e9900 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] validate_networks() for [('5eab384c-36ea-4de9-9630-bc1a7d6a1dac', None, None, None, None, None)] {{(pid=116097) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:15:46.629792 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-d0093cf4-3307-4e39-aac3-e33eef6e9900 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Flavor limits 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:15:46.630235 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-d0093cf4-3307-4e39-aac3-e33eef6e9900 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Image limits 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:15:46.630707 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-d0093cf4-3307-4e39-aac3-e33eef6e9900 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Flavor pref 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:15:46.631110 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-d0093cf4-3307-4e39-aac3-e33eef6e9900 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Image pref 0:0:0 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:15:46.631515 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.virt.hardware [None req-d0093cf4-3307-4e39-aac3-e33eef6e9900 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:15:46.640862 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d0093cf4-3307-4e39-aac3-e33eef6e9900 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:46.641305 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d0093cf4-3307-4e39-aac3-e33eef6e9900 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:46.642106 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d0093cf4-3307-4e39-aac3-e33eef6e9900 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:46.642563 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d0093cf4-3307-4e39-aac3-e33eef6e9900 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:46.658601 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-d0093cf4-3307-4e39-aac3-e33eef6e9900 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Getting quotas for project 85b5372522d64067b34faa325b4dc400. Resources: {'instances', 'cores', 'ram'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:15:46.662354 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.quota [None req-d0093cf4-3307-4e39-aac3-e33eef6e9900 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Getting quotas for user 913f4595b6444821801332dacab3c616 and project 85b5372522d64067b34faa325b4dc400. Resources: {'instances', 'cores', 'ram'} {{(pid=116097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:15:46.716350 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-d0093cf4-3307-4e39-aac3-e33eef6e9900 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Going to run 1 instances... {{(pid=116097) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:15:46.718466 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-d0093cf4-3307-4e39-aac3-e33eef6e9900 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: da09d84c-6634-41b1-91e6-7d6e0a941973] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c6082279-1e5a-4162-ad68-e0fb51920461',volume_size=None,volume_type=None)] {{(pid=116097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:15:46.838584 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-d0093cf4-3307-4e39-aac3-e33eef6e9900 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.783615 Dec 15 13:15:46.839222 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 642/1345] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Dec 15 13:15:46 2021] POST /compute/v2.1/servers => generated 406 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:15:46.850207 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-767f540c-de37-4f85-940b-b35a74815188 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:15:46.850819 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-767f540c-de37-4f85-940b-b35a74815188 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: da09d84c-6634-41b1-91e6-7d6e0a941973] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:15:46.905881 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-767f540c-de37-4f85-940b-b35a74815188 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:15:46.912703 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-767f540c-de37-4f85-940b-b35a74815188 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973" status: 200 len: 1093 microversion: 2.1 time: 0.067470 Dec 15 13:15:46.913469 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 704/1346] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:15:46 2021] GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973 => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:15:47.931384 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-89be7bdb-44b7-4a2b-bb28-b0752108683e tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:15:47.932055 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-89be7bdb-44b7-4a2b-bb28-b0752108683e tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: da09d84c-6634-41b1-91e6-7d6e0a941973] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:15:47.938895 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-89be7bdb-44b7-4a2b-bb28-b0752108683e tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:47.939351 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-89be7bdb-44b7-4a2b-bb28-b0752108683e tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:47.940705 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-89be7bdb-44b7-4a2b-bb28-b0752108683e tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:47.941214 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-89be7bdb-44b7-4a2b-bb28-b0752108683e tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:48.035519 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-89be7bdb-44b7-4a2b-bb28-b0752108683e tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:15:48.042814 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-89be7bdb-44b7-4a2b-bb28-b0752108683e tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973" status: 200 len: 1209 microversion: 2.1 time: 0.116268 Dec 15 13:15:48.043376 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 643/1347] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:15:47 2021] GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973 => generated 1209 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:15:49.059608 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7076ee51-1177-41a7-bd3c-eea418c67c6c tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:15:49.060225 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7076ee51-1177-41a7-bd3c-eea418c67c6c tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: da09d84c-6634-41b1-91e6-7d6e0a941973] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:15:49.066985 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7076ee51-1177-41a7-bd3c-eea418c67c6c tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:49.067455 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7076ee51-1177-41a7-bd3c-eea418c67c6c tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:49.068238 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7076ee51-1177-41a7-bd3c-eea418c67c6c tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:49.068677 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7076ee51-1177-41a7-bd3c-eea418c67c6c tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:49.252039 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-7076ee51-1177-41a7-bd3c-eea418c67c6c tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:15:49.266227 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7076ee51-1177-41a7-bd3c-eea418c67c6c tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973" status: 200 len: 1265 microversion: 2.1 time: 0.210545 Dec 15 13:15:49.270181 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 705/1348] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:15:49 2021] GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973 => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:15:49.342112 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [req-93be4cc8-33ad-460a-95b9-2ea71f31fc93 req-845bf64e-707b-4d9e-930d-f4e1782e6cdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da09d84c-6634-41b1-91e6-7d6e0a941973", "tag": "7338e8ac-6413-485a-8931-2925e79eae1a"}]} {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:15:49.343713 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:15:49.343713 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: warnings.warn(msg) Dec 15 13:15:49.350929 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-93be4cc8-33ad-460a-95b9-2ea71f31fc93 req-845bf64e-707b-4d9e-930d-f4e1782e6cdd service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:49.351465 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [req-93be4cc8-33ad-460a-95b9-2ea71f31fc93 req-845bf64e-707b-4d9e-930d-f4e1782e6cdd service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:49.364103 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.compute.server_external_events [req-93be4cc8-33ad-460a-95b9-2ea71f31fc93 req-845bf64e-707b-4d9e-930d-f4e1782e6cdd service nova] Creating event network-changed:7338e8ac-6413-485a-8931-2925e79eae1a for instance da09d84c-6634-41b1-91e6-7d6e0a941973 on hv-cinder-81322 Dec 15 13:15:49.369116 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [req-93be4cc8-33ad-460a-95b9-2ea71f31fc93 req-845bf64e-707b-4d9e-930d-f4e1782e6cdd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191834 Dec 15 13:15:49.369712 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 644/1349] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:15:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:15:50.286907 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-31306d86-251a-46c4-98f9-75fe624ec304 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:15:50.287455 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-31306d86-251a-46c4-98f9-75fe624ec304 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: da09d84c-6634-41b1-91e6-7d6e0a941973] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:15:50.293659 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-31306d86-251a-46c4-98f9-75fe624ec304 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:50.294102 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-31306d86-251a-46c4-98f9-75fe624ec304 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:50.294972 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-31306d86-251a-46c4-98f9-75fe624ec304 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:50.295406 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-31306d86-251a-46c4-98f9-75fe624ec304 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:50.425628 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-31306d86-251a-46c4-98f9-75fe624ec304 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:15:50.433601 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-31306d86-251a-46c4-98f9-75fe624ec304 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973" status: 200 len: 1265 microversion: 2.1 time: 0.149970 Dec 15 13:15:50.434233 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 706/1350] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:15:50 2021] GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:15:51.451843 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-f67ed838-3153-45dc-a7f5-e4d26bc6ea9b tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:15:51.452539 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-f67ed838-3153-45dc-a7f5-e4d26bc6ea9b tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: da09d84c-6634-41b1-91e6-7d6e0a941973] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:15:51.458665 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f67ed838-3153-45dc-a7f5-e4d26bc6ea9b tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:51.459115 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f67ed838-3153-45dc-a7f5-e4d26bc6ea9b tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:51.459902 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f67ed838-3153-45dc-a7f5-e4d26bc6ea9b tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:51.460346 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f67ed838-3153-45dc-a7f5-e4d26bc6ea9b tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:51.592681 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-f67ed838-3153-45dc-a7f5-e4d26bc6ea9b tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:15:51.599914 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-f67ed838-3153-45dc-a7f5-e4d26bc6ea9b tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973" status: 200 len: 1265 microversion: 2.1 time: 0.153087 Dec 15 13:15:51.600515 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 645/1351] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:15:51 2021] GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:15:52.616548 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8a86d51d-7846-4225-91b5-8f2262e01e6a tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:15:52.617095 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8a86d51d-7846-4225-91b5-8f2262e01e6a tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: da09d84c-6634-41b1-91e6-7d6e0a941973] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:15:52.623333 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8a86d51d-7846-4225-91b5-8f2262e01e6a tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:52.623789 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8a86d51d-7846-4225-91b5-8f2262e01e6a tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:52.624569 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8a86d51d-7846-4225-91b5-8f2262e01e6a tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:52.625007 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8a86d51d-7846-4225-91b5-8f2262e01e6a tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:52.758128 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8a86d51d-7846-4225-91b5-8f2262e01e6a tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:15:52.766466 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8a86d51d-7846-4225-91b5-8f2262e01e6a tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973" status: 200 len: 1265 microversion: 2.1 time: 0.153637 Dec 15 13:15:52.767027 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 707/1352] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:15:52 2021] GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:15:53.783833 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-7f34e8e1-0863-4946-91d7-530fc36b2343 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:15:53.784428 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-7f34e8e1-0863-4946-91d7-530fc36b2343 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: da09d84c-6634-41b1-91e6-7d6e0a941973] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:15:53.790727 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7f34e8e1-0863-4946-91d7-530fc36b2343 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:53.791184 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7f34e8e1-0863-4946-91d7-530fc36b2343 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:53.791961 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7f34e8e1-0863-4946-91d7-530fc36b2343 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:53.792568 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-7f34e8e1-0863-4946-91d7-530fc36b2343 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:53.927121 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-7f34e8e1-0863-4946-91d7-530fc36b2343 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:15:53.934360 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-7f34e8e1-0863-4946-91d7-530fc36b2343 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973" status: 200 len: 1265 microversion: 2.1 time: 0.154276 Dec 15 13:15:53.934918 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 646/1353] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:15:53 2021] GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:15:54.951554 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0be44425-9e2f-4f82-a295-e0b6b198296f tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:15:54.952156 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0be44425-9e2f-4f82-a295-e0b6b198296f tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: da09d84c-6634-41b1-91e6-7d6e0a941973] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:15:54.958410 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0be44425-9e2f-4f82-a295-e0b6b198296f tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:54.958859 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0be44425-9e2f-4f82-a295-e0b6b198296f tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:54.959663 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0be44425-9e2f-4f82-a295-e0b6b198296f tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:54.960097 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0be44425-9e2f-4f82-a295-e0b6b198296f tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:55.088573 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0be44425-9e2f-4f82-a295-e0b6b198296f tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:15:55.096533 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-0be44425-9e2f-4f82-a295-e0b6b198296f tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973" status: 200 len: 1265 microversion: 2.1 time: 0.149236 Dec 15 13:15:55.097091 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 708/1354] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:15:54 2021] GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:15:56.113706 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-d0a8efb5-bc26-43fc-a4c3-f274957ddd8c tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:15:56.114279 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-d0a8efb5-bc26-43fc-a4c3-f274957ddd8c tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: da09d84c-6634-41b1-91e6-7d6e0a941973] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:15:56.120430 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d0a8efb5-bc26-43fc-a4c3-f274957ddd8c tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:56.121514 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d0a8efb5-bc26-43fc-a4c3-f274957ddd8c tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:56.122319 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d0a8efb5-bc26-43fc-a4c3-f274957ddd8c tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:56.122756 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d0a8efb5-bc26-43fc-a4c3-f274957ddd8c tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:56.252175 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-d0a8efb5-bc26-43fc-a4c3-f274957ddd8c tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:15:56.259520 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-d0a8efb5-bc26-43fc-a4c3-f274957ddd8c tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973" status: 200 len: 1265 microversion: 2.1 time: 0.149556 Dec 15 13:15:56.260081 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 647/1355] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:15:56 2021] GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:15:57.275498 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d56e9eac-b76d-42f2-8100-74d1a7358cbc tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:15:57.276149 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d56e9eac-b76d-42f2-8100-74d1a7358cbc tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: da09d84c-6634-41b1-91e6-7d6e0a941973] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:15:57.282821 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d56e9eac-b76d-42f2-8100-74d1a7358cbc tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:57.283262 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d56e9eac-b76d-42f2-8100-74d1a7358cbc tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:57.284020 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d56e9eac-b76d-42f2-8100-74d1a7358cbc tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:57.284446 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d56e9eac-b76d-42f2-8100-74d1a7358cbc tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:57.415660 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d56e9eac-b76d-42f2-8100-74d1a7358cbc tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:15:57.423070 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d56e9eac-b76d-42f2-8100-74d1a7358cbc tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973" status: 200 len: 1265 microversion: 2.1 time: 0.151187 Dec 15 13:15:57.423632 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 709/1356] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:15:57 2021] GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:15:58.440268 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-d92defa8-bae5-4a24-b753-fe0d2670ccc8 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:15:58.440875 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-d92defa8-bae5-4a24-b753-fe0d2670ccc8 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: da09d84c-6634-41b1-91e6-7d6e0a941973] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:15:58.447051 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d92defa8-bae5-4a24-b753-fe0d2670ccc8 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:58.447502 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d92defa8-bae5-4a24-b753-fe0d2670ccc8 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:58.448272 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d92defa8-bae5-4a24-b753-fe0d2670ccc8 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:58.448703 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-d92defa8-bae5-4a24-b753-fe0d2670ccc8 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:58.581911 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-d92defa8-bae5-4a24-b753-fe0d2670ccc8 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:15:58.589288 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-d92defa8-bae5-4a24-b753-fe0d2670ccc8 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973" status: 200 len: 1265 microversion: 2.1 time: 0.152620 Dec 15 13:15:58.590365 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 648/1357] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:15:58 2021] GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:15:58.656110 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-9997bb5a-e1d0-42ad-ad5f-c624d226ce98 req-2841ec26-8350-40ee-8707-50349d3389fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da09d84c-6634-41b1-91e6-7d6e0a941973", "name": "network-vif-plugged", "status": "completed", "tag": "7338e8ac-6413-485a-8931-2925e79eae1a"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:15:58.657891 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:15:58.657891 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:15:58.664647 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-9997bb5a-e1d0-42ad-ad5f-c624d226ce98 req-2841ec26-8350-40ee-8707-50349d3389fa service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:58.665079 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-9997bb5a-e1d0-42ad-ad5f-c624d226ce98 req-2841ec26-8350-40ee-8707-50349d3389fa service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:58.676461 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-9997bb5a-e1d0-42ad-ad5f-c624d226ce98 req-2841ec26-8350-40ee-8707-50349d3389fa service nova] Creating event network-vif-plugged:7338e8ac-6413-485a-8931-2925e79eae1a for instance da09d84c-6634-41b1-91e6-7d6e0a941973 on hv-cinder-81322 Dec 15 13:15:58.681204 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-9997bb5a-e1d0-42ad-ad5f-c624d226ce98 req-2841ec26-8350-40ee-8707-50349d3389fa service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092860 Dec 15 13:15:58.681760 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 710/1358] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:15:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:15:59.607014 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-4119874d-a046-4ab5-9246-2437dcdc74c4 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:15:59.607666 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-4119874d-a046-4ab5-9246-2437dcdc74c4 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: da09d84c-6634-41b1-91e6-7d6e0a941973] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:15:59.614168 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4119874d-a046-4ab5-9246-2437dcdc74c4 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:59.614618 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4119874d-a046-4ab5-9246-2437dcdc74c4 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:59.615465 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4119874d-a046-4ab5-9246-2437dcdc74c4 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:59.615903 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4119874d-a046-4ab5-9246-2437dcdc74c4 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:59.745762 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-4119874d-a046-4ab5-9246-2437dcdc74c4 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:15:59.753517 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-4119874d-a046-4ab5-9246-2437dcdc74c4 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973" status: 200 len: 1265 microversion: 2.1 time: 0.150867 Dec 15 13:15:59.754076 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 649/1359] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:15:59 2021] GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:16:00.771176 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-19ab85a1-a8f4-4008-8ffe-0a0da39ef599 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:16:00.771872 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-19ab85a1-a8f4-4008-8ffe-0a0da39ef599 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: da09d84c-6634-41b1-91e6-7d6e0a941973] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:16:00.777954 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-19ab85a1-a8f4-4008-8ffe-0a0da39ef599 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:16:00.778426 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-19ab85a1-a8f4-4008-8ffe-0a0da39ef599 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:16:00.779195 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-19ab85a1-a8f4-4008-8ffe-0a0da39ef599 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:16:00.779630 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-19ab85a1-a8f4-4008-8ffe-0a0da39ef599 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:16:00.911107 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-19ab85a1-a8f4-4008-8ffe-0a0da39ef599 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:16:00.918274 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-19ab85a1-a8f4-4008-8ffe-0a0da39ef599 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973" status: 200 len: 1451 microversion: 2.1 time: 0.151779 Dec 15 13:16:00.918896 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 711/1360] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:16:00 2021] GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:16:00.934523 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-1738fa06-3fe5-4b90-91e1-0cf7604695a3 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:16:00.935156 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-1738fa06-3fe5-4b90-91e1-0cf7604695a3 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: da09d84c-6634-41b1-91e6-7d6e0a941973] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:16:00.941553 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1738fa06-3fe5-4b90-91e1-0cf7604695a3 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:16:00.942014 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1738fa06-3fe5-4b90-91e1-0cf7604695a3 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:16:00.942858 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1738fa06-3fe5-4b90-91e1-0cf7604695a3 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:16:00.943303 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-1738fa06-3fe5-4b90-91e1-0cf7604695a3 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:16:01.074735 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-1738fa06-3fe5-4b90-91e1-0cf7604695a3 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:16:01.082512 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-1738fa06-3fe5-4b90-91e1-0cf7604695a3 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973" status: 200 len: 1451 microversion: 2.1 time: 0.152187 Dec 15 13:16:01.083077 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 650/1361] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:16:00 2021] GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:16:02.884911 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-1b94135a-f591-4475-9a4b-60151180154b req-65427330-2c1e-4a1e-a058-1be9ef7a27f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da09d84c-6634-41b1-91e6-7d6e0a941973", "tag": "7338e8ac-6413-485a-8931-2925e79eae1a"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:16:02.886648 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:16:02.886648 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:16:02.894479 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-1b94135a-f591-4475-9a4b-60151180154b req-65427330-2c1e-4a1e-a058-1be9ef7a27f7 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:16:02.894995 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-1b94135a-f591-4475-9a4b-60151180154b req-65427330-2c1e-4a1e-a058-1be9ef7a27f7 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:16:02.905549 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-1b94135a-f591-4475-9a4b-60151180154b req-65427330-2c1e-4a1e-a058-1be9ef7a27f7 service nova] Creating event network-changed:7338e8ac-6413-485a-8931-2925e79eae1a for instance da09d84c-6634-41b1-91e6-7d6e0a941973 on hv-cinder-81322 Dec 15 13:16:02.910431 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-1b94135a-f591-4475-9a4b-60151180154b req-65427330-2c1e-4a1e-a058-1be9ef7a27f7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029039 Dec 15 13:16:02.911015 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 712/1362] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:16:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:17:25.723353 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:17:25.724076 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: Wed Dec 15 13:17:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:17:32.055712 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-4b7ad9aa-91d6-4a5c-a0ce-c15da39cccd3 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:17:32.056369 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-4b7ad9aa-91d6-4a5c-a0ce-c15da39cccd3 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: da09d84c-6634-41b1-91e6-7d6e0a941973] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:32.062739 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-b9bdfd71-f1d9-4ccb-b012-fb48daeb14af req-77082ffd-b30c-4805-8acf-ac11e4f3df9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da09d84c-6634-41b1-91e6-7d6e0a941973", "tag": "7338e8ac-6413-485a-8931-2925e79eae1a"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:32.064333 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:17:32.064333 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:17:32.071281 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4b7ad9aa-91d6-4a5c-a0ce-c15da39cccd3 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:32.071690 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-b9bdfd71-f1d9-4ccb-b012-fb48daeb14af req-77082ffd-b30c-4805-8acf-ac11e4f3df9b service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:32.071842 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4b7ad9aa-91d6-4a5c-a0ce-c15da39cccd3 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:32.072250 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-b9bdfd71-f1d9-4ccb-b012-fb48daeb14af req-77082ffd-b30c-4805-8acf-ac11e4f3df9b service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:32.072522 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4b7ad9aa-91d6-4a5c-a0ce-c15da39cccd3 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:32.072967 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-4b7ad9aa-91d6-4a5c-a0ce-c15da39cccd3 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:32.083439 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-b9bdfd71-f1d9-4ccb-b012-fb48daeb14af req-77082ffd-b30c-4805-8acf-ac11e4f3df9b service nova] Creating event network-changed:7338e8ac-6413-485a-8931-2925e79eae1a for instance da09d84c-6634-41b1-91e6-7d6e0a941973 on hv-cinder-81322 Dec 15 13:17:32.088972 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-b9bdfd71-f1d9-4ccb-b012-fb48daeb14af req-77082ffd-b30c-4805-8acf-ac11e4f3df9b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031109 Dec 15 13:17:32.089845 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 713/1363] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:17:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:17:32.100009 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-4b7ad9aa-91d6-4a5c-a0ce-c15da39cccd3 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: da09d84c-6634-41b1-91e6-7d6e0a941973] Going to try to terminate instance {{(pid=116097) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:17:32.184592 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-4b7ad9aa-91d6-4a5c-a0ce-c15da39cccd3 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "DELETE /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973" status: 204 len: 0 microversion: 2.1 time: 0.133666 Dec 15 13:17:32.185570 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 651/1364] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Dec 15 13:17:32 2021] DELETE /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:17:32.194768 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-2182e3ad-3733-4325-93f0-d779da40d4f0 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:17:32.195973 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-2182e3ad-3733-4325-93f0-d779da40d4f0 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: da09d84c-6634-41b1-91e6-7d6e0a941973] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:32.205597 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2182e3ad-3733-4325-93f0-d779da40d4f0 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:32.206644 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2182e3ad-3733-4325-93f0-d779da40d4f0 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:32.207724 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2182e3ad-3733-4325-93f0-d779da40d4f0 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:32.208389 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2182e3ad-3733-4325-93f0-d779da40d4f0 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:32.353164 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-2182e3ad-3733-4325-93f0-d779da40d4f0 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:17:32.360972 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-2182e3ad-3733-4325-93f0-d779da40d4f0 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973" status: 200 len: 1575 microversion: 2.1 time: 0.170643 Dec 15 13:17:32.361727 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 714/1365] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:17:32 2021] GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973 => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:17:33.378499 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-895d5ec1-6e0a-425d-b301-9831634f5c8d tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:17:33.379129 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-895d5ec1-6e0a-425d-b301-9831634f5c8d tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: da09d84c-6634-41b1-91e6-7d6e0a941973] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:33.385822 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-895d5ec1-6e0a-425d-b301-9831634f5c8d tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:33.386313 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-895d5ec1-6e0a-425d-b301-9831634f5c8d tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:33.387129 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-895d5ec1-6e0a-425d-b301-9831634f5c8d tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:33.387636 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-895d5ec1-6e0a-425d-b301-9831634f5c8d tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:33.530411 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-895d5ec1-6e0a-425d-b301-9831634f5c8d tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:17:33.538285 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-895d5ec1-6e0a-425d-b301-9831634f5c8d tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973" status: 200 len: 1457 microversion: 2.1 time: 0.164121 Dec 15 13:17:33.538840 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 652/1366] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:17:33 2021] GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973 => generated 1457 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:17:34.198161 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-84136ee3-bd37-4e9c-96c0-d2b7d793c58e req-6133901a-d12a-4901-91b6-ceb14f7b7568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da09d84c-6634-41b1-91e6-7d6e0a941973", "name": "network-vif-deleted", "tag": "7338e8ac-6413-485a-8931-2925e79eae1a"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:34.199951 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:17:34.199951 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:17:34.210354 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-84136ee3-bd37-4e9c-96c0-d2b7d793c58e req-6133901a-d12a-4901-91b6-ceb14f7b7568 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:34.210805 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-84136ee3-bd37-4e9c-96c0-d2b7d793c58e req-6133901a-d12a-4901-91b6-ceb14f7b7568 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:34.222243 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-84136ee3-bd37-4e9c-96c0-d2b7d793c58e req-6133901a-d12a-4901-91b6-ceb14f7b7568 service nova] Creating event network-vif-deleted:7338e8ac-6413-485a-8931-2925e79eae1a for instance da09d84c-6634-41b1-91e6-7d6e0a941973 on hv-cinder-81322 Dec 15 13:17:34.227745 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-84136ee3-bd37-4e9c-96c0-d2b7d793c58e req-6133901a-d12a-4901-91b6-ceb14f7b7568 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033550 Dec 15 13:17:34.228327 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 715/1367] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:17:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:17:34.555223 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-b232f2b1-9f75-4dae-ae73-6cc2a7459d8c tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:17:34.555827 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-b232f2b1-9f75-4dae-ae73-6cc2a7459d8c tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: da09d84c-6634-41b1-91e6-7d6e0a941973] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:34.563287 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b232f2b1-9f75-4dae-ae73-6cc2a7459d8c tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:34.563768 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b232f2b1-9f75-4dae-ae73-6cc2a7459d8c tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:34.564609 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b232f2b1-9f75-4dae-ae73-6cc2a7459d8c tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:34.565044 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b232f2b1-9f75-4dae-ae73-6cc2a7459d8c tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:34.597449 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b232f2b1-9f75-4dae-ae73-6cc2a7459d8c tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:34.597971 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-b232f2b1-9f75-4dae-ae73-6cc2a7459d8c tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:34.598420 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.objects.instance [None req-b232f2b1-9f75-4dae-ae73-6cc2a7459d8c tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lazy-loading 'fault' on Instance uuid da09d84c-6634-41b1-91e6-7d6e0a941973 {{(pid=116097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:17:34.642682 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-b232f2b1-9f75-4dae-ae73-6cc2a7459d8c tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:17:34.649899 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-b232f2b1-9f75-4dae-ae73-6cc2a7459d8c tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973" status: 200 len: 1229 microversion: 2.1 time: 0.098970 Dec 15 13:17:34.650500 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 653/1368] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:17:34 2021] GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973 => generated 1229 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:17:35.667250 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-791f35cb-89aa-4f67-88ce-c1f42b743022 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:17:35.667966 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-791f35cb-89aa-4f67-88ce-c1f42b743022 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: da09d84c-6634-41b1-91e6-7d6e0a941973] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:35.674559 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-791f35cb-89aa-4f67-88ce-c1f42b743022 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:35.675006 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-791f35cb-89aa-4f67-88ce-c1f42b743022 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:35.675775 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-791f35cb-89aa-4f67-88ce-c1f42b743022 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:35.676205 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-791f35cb-89aa-4f67-88ce-c1f42b743022 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:35.689694 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-791f35cb-89aa-4f67-88ce-c1f42b743022 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] HTTP exception thrown: Instance da09d84c-6634-41b1-91e6-7d6e0a941973 could not be found. Dec 15 13:17:35.690306 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-791f35cb-89aa-4f67-88ce-c1f42b743022 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Returning 404 to user: Instance da09d84c-6634-41b1-91e6-7d6e0a941973 could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:17:35.691130 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-791f35cb-89aa-4f67-88ce-c1f42b743022 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973" status: 404 len: 111 microversion: 2.1 time: 0.027966 Dec 15 13:17:35.691669 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 716/1369] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:17:35 2021] GET /compute/v2.1/servers/da09d84c-6634-41b1-91e6-7d6e0a941973 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:17:38.789911 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-6439fc85-7553-4cbc-a8a9-184f494fe410 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:17:38.790606 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-6439fc85-7553-4cbc-a8a9-184f494fe410 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: 6015b216-5022-4672-a69b-fc2e3bd8734f] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:38.792569 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-bdfe286c-9229-4cef-a373-0a145b2b6475 req-4169242c-8533-4169-b315-fbf9b4d98243 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6015b216-5022-4672-a69b-fc2e3bd8734f", "tag": "c87b005e-ad36-475c-a467-08a5c29fea89"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:38.794076 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:17:38.794076 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:17:38.797545 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6439fc85-7553-4cbc-a8a9-184f494fe410 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:38.798110 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6439fc85-7553-4cbc-a8a9-184f494fe410 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:38.799031 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6439fc85-7553-4cbc-a8a9-184f494fe410 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:38.799687 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-6439fc85-7553-4cbc-a8a9-184f494fe410 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:38.801577 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-bdfe286c-9229-4cef-a373-0a145b2b6475 req-4169242c-8533-4169-b315-fbf9b4d98243 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:38.802469 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-bdfe286c-9229-4cef-a373-0a145b2b6475 req-4169242c-8533-4169-b315-fbf9b4d98243 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:38.817889 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-bdfe286c-9229-4cef-a373-0a145b2b6475 req-4169242c-8533-4169-b315-fbf9b4d98243 service nova] Creating event network-changed:c87b005e-ad36-475c-a467-08a5c29fea89 for instance 6015b216-5022-4672-a69b-fc2e3bd8734f on hv-cinder-81322 Dec 15 13:17:38.823270 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-bdfe286c-9229-4cef-a373-0a145b2b6475 req-4169242c-8533-4169-b315-fbf9b4d98243 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034271 Dec 15 13:17:38.823865 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 717/1370] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:17:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:17:38.826685 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-6439fc85-7553-4cbc-a8a9-184f494fe410 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: 6015b216-5022-4672-a69b-fc2e3bd8734f] Going to try to terminate instance {{(pid=116097) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:17:38.910782 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-6439fc85-7553-4cbc-a8a9-184f494fe410 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f" status: 204 len: 0 microversion: 2.1 time: 0.124371 Dec 15 13:17:38.914230 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 654/1371] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Dec 15 13:17:38 2021] DELETE /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:17:38.920435 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c5db7315-dc68-4e0d-99ed-75d0ea11327d tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:17:38.921188 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c5db7315-dc68-4e0d-99ed-75d0ea11327d tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: 6015b216-5022-4672-a69b-fc2e3bd8734f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:38.927770 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c5db7315-dc68-4e0d-99ed-75d0ea11327d tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:38.928252 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c5db7315-dc68-4e0d-99ed-75d0ea11327d tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:38.929137 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c5db7315-dc68-4e0d-99ed-75d0ea11327d tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:38.929579 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c5db7315-dc68-4e0d-99ed-75d0ea11327d tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:39.078004 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c5db7315-dc68-4e0d-99ed-75d0ea11327d tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:17:39.087220 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c5db7315-dc68-4e0d-99ed-75d0ea11327d tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f" status: 200 len: 1575 microversion: 2.1 time: 0.170342 Dec 15 13:17:39.088030 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 718/1372] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:17:38 2021] GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:17:40.106193 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-31e733bc-6602-464a-bc6f-28651b735373 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:17:40.106804 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-31e733bc-6602-464a-bc6f-28651b735373 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: 6015b216-5022-4672-a69b-fc2e3bd8734f] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:40.113020 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-31e733bc-6602-464a-bc6f-28651b735373 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:40.113469 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-31e733bc-6602-464a-bc6f-28651b735373 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:40.114280 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-31e733bc-6602-464a-bc6f-28651b735373 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:40.114722 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-31e733bc-6602-464a-bc6f-28651b735373 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:40.253155 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-31e733bc-6602-464a-bc6f-28651b735373 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:17:40.261245 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-31e733bc-6602-464a-bc6f-28651b735373 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f" status: 200 len: 1456 microversion: 2.1 time: 0.159232 Dec 15 13:17:40.261810 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 655/1373] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:17:40 2021] GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f => generated 1456 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:17:40.845761 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-52f19061-590b-40ba-898e-14f3579b83df req-8ef8d3a2-dbb8-4504-b1d9-1acdb5d8a013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6015b216-5022-4672-a69b-fc2e3bd8734f", "name": "network-vif-deleted", "tag": "c87b005e-ad36-475c-a467-08a5c29fea89"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:40.847435 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:17:40.847435 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Dec 15 13:17:40.856224 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-52f19061-590b-40ba-898e-14f3579b83df req-8ef8d3a2-dbb8-4504-b1d9-1acdb5d8a013 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:40.856673 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-52f19061-590b-40ba-898e-14f3579b83df req-8ef8d3a2-dbb8-4504-b1d9-1acdb5d8a013 service nova] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:40.869936 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-52f19061-590b-40ba-898e-14f3579b83df req-8ef8d3a2-dbb8-4504-b1d9-1acdb5d8a013 service nova] Creating event network-vif-deleted:c87b005e-ad36-475c-a467-08a5c29fea89 for instance 6015b216-5022-4672-a69b-fc2e3bd8734f on hv-cinder-81322 Dec 15 13:17:40.874977 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-52f19061-590b-40ba-898e-14f3579b83df req-8ef8d3a2-dbb8-4504-b1d9-1acdb5d8a013 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032860 Dec 15 13:17:40.875565 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 719/1374] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Dec 15 13:17:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:17:41.278800 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-f1c6131d-47a7-4668-afd9-a6f16c52e1e8 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:17:41.279416 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-f1c6131d-47a7-4668-afd9-a6f16c52e1e8 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: 6015b216-5022-4672-a69b-fc2e3bd8734f] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:41.285675 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f1c6131d-47a7-4668-afd9-a6f16c52e1e8 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:41.286789 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f1c6131d-47a7-4668-afd9-a6f16c52e1e8 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:41.287567 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f1c6131d-47a7-4668-afd9-a6f16c52e1e8 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:41.288001 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f1c6131d-47a7-4668-afd9-a6f16c52e1e8 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:41.318768 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f1c6131d-47a7-4668-afd9-a6f16c52e1e8 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:41.319148 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-f1c6131d-47a7-4668-afd9-a6f16c52e1e8 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:41.319589 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.objects.instance [None req-f1c6131d-47a7-4668-afd9-a6f16c52e1e8 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lazy-loading 'fault' on Instance uuid 6015b216-5022-4672-a69b-fc2e3bd8734f {{(pid=116097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:17:41.361765 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.policy [None req-f1c6131d-47a7-4668-afd9-a6f16c52e1e8 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913f4595b6444821801332dacab3c616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85b5372522d64067b34faa325b4dc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116097) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:17:41.368993 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-f1c6131d-47a7-4668-afd9-a6f16c52e1e8 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f" status: 200 len: 1228 microversion: 2.1 time: 0.094118 Dec 15 13:17:41.369552 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 656/1375] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:17:41 2021] GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f => generated 1228 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:17:42.387755 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-edb3ef54-f0d4-49f2-86c8-88e5dd7f0e31 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:17:42.388442 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-edb3ef54-f0d4-49f2-86c8-88e5dd7f0e31 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: 6015b216-5022-4672-a69b-fc2e3bd8734f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:42.394530 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-edb3ef54-f0d4-49f2-86c8-88e5dd7f0e31 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:42.394978 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-edb3ef54-f0d4-49f2-86c8-88e5dd7f0e31 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:42.395744 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-edb3ef54-f0d4-49f2-86c8-88e5dd7f0e31 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:42.396178 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-edb3ef54-f0d4-49f2-86c8-88e5dd7f0e31 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:42.409057 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-edb3ef54-f0d4-49f2-86c8-88e5dd7f0e31 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] HTTP exception thrown: Instance 6015b216-5022-4672-a69b-fc2e3bd8734f could not be found. Dec 15 13:17:42.409633 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-edb3ef54-f0d4-49f2-86c8-88e5dd7f0e31 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Returning 404 to user: Instance 6015b216-5022-4672-a69b-fc2e3bd8734f could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:17:42.410467 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-edb3ef54-f0d4-49f2-86c8-88e5dd7f0e31 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f" status: 404 len: 111 microversion: 2.1 time: 0.027262 Dec 15 13:17:42.410989 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 720/1376] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:17:42 2021] GET /compute/v2.1/servers/6015b216-5022-4672-a69b-fc2e3bd8734f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:17:42.844082 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-90488d8c-39f3-4e29-ae47-caef1a2f9f53 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:17:42.844615 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.compute.api [None req-90488d8c-39f3-4e29-ae47-caef1a2f9f53 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: b14ea93a-eff2-476e-9a50-8352bfa100f9] Fetching instance by UUID {{(pid=116097) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:42.851439 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-90488d8c-39f3-4e29-ae47-caef1a2f9f53 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:42.851889 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-90488d8c-39f3-4e29-ae47-caef1a2f9f53 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:42.852663 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-90488d8c-39f3-4e29-ae47-caef1a2f9f53 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:42.853099 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG oslo_concurrency.lockutils [None req-90488d8c-39f3-4e29-ae47-caef1a2f9f53 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:42.866372 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.wsgi [None req-90488d8c-39f3-4e29-ae47-caef1a2f9f53 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] HTTP exception thrown: Instance b14ea93a-eff2-476e-9a50-8352bfa100f9 could not be found. Dec 15 13:17:42.866956 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-90488d8c-39f3-4e29-ae47-caef1a2f9f53 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Returning 404 to user: Instance b14ea93a-eff2-476e-9a50-8352bfa100f9 could not be found. {{(pid=116097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:17:42.867778 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-90488d8c-39f3-4e29-ae47-caef1a2f9f53 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9" status: 404 len: 111 microversion: 2.1 time: 0.027398 Dec 15 13:17:42.868318 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 657/1377] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Dec 15 13:17:42 2021] DELETE /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:17:42.876204 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4fb2bcd0-257e-4ca4-bff5-5d9c2db37ec2 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:17:42.876801 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4fb2bcd0-257e-4ca4-bff5-5d9c2db37ec2 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] [instance: b14ea93a-eff2-476e-9a50-8352bfa100f9] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:42.883024 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4fb2bcd0-257e-4ca4-bff5-5d9c2db37ec2 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:42.883478 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4fb2bcd0-257e-4ca4-bff5-5d9c2db37ec2 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:42.884234 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4fb2bcd0-257e-4ca4-bff5-5d9c2db37ec2 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:42.884664 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4fb2bcd0-257e-4ca4-bff5-5d9c2db37ec2 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Lock "8e3cf188-1511-4f3a-b1c2-340794a1deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:42.898344 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-4fb2bcd0-257e-4ca4-bff5-5d9c2db37ec2 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] HTTP exception thrown: Instance b14ea93a-eff2-476e-9a50-8352bfa100f9 could not be found. Dec 15 13:17:42.898924 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4fb2bcd0-257e-4ca4-bff5-5d9c2db37ec2 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Returning 404 to user: Instance b14ea93a-eff2-476e-9a50-8352bfa100f9 could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:17:42.899745 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4fb2bcd0-257e-4ca4-bff5-5d9c2db37ec2 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9" status: 404 len: 111 microversion: 2.1 time: 0.027184 Dec 15 13:17:42.900300 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 721/1378] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Dec 15 13:17:42 2021] GET /compute/v2.1/servers/b14ea93a-eff2-476e-9a50-8352bfa100f9 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:17:43.694469 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:17:43.695159 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: Wed Dec 15 13:17:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:17:44.176949 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: DEBUG nova.api.openstack.wsgi [None req-fb69422d-9c8d-464d-a8bb-772760faeb35 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] Calling method '.version_select at 0x7faf18113820>' {{(pid=116097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:17:44.198284 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO nova.api.openstack.requestlog [None req-fb69422d-9c8d-464d-a8bb-772760faeb35 tempest-TestVolumeBootPattern-1894578014 tempest-TestVolumeBootPattern-1894578014-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-763252721" status: 202 len: 0 microversion: 2.1 time: 0.024689 Dec 15 13:17:44.202251 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: [pid: 116097|app: 0|req: 658/1379] 10.222.0.57 () {58 vars in 1259 bytes} [Wed Dec 15 13:17:44 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-763252721 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:19:01.200124 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:19:01.200838 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: Wed Dec 15 13:19:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:19:01.710567 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:19:01.711146 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: Wed Dec 15 13:19:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:20:45.741327 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:20:45.741984 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: Wed Dec 15 13:20:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:20:57.811045 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:20:57.811610 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: Wed Dec 15 13:20:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:21:03.713367 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:21:03.714068 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: Wed Dec 15 13:21:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:22:21.217681 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:22:21.218349 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: Wed Dec 15 13:22:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:22:21.728197 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:22:21.728786 dv-cinder-813226-4-iscsi devstack@n-api.service[116098]: Wed Dec 15 13:22:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:22:39.532524 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:22:39.533152 dv-cinder-813226-4-iscsi devstack@n-api.service[116097]: Wed Dec 15 13:22:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!